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ABSTRACT 


This research investigated signal processing of two dimensional signals for the 
detection of targets in noise, particularly in complex background pattern noise. The 
researchers hypothesized that this type of noise was vulnerable to non-linear 
processing. They investigated whether the human eye/brain acting as a surrogate for 
a non-hnear processor could outperform an optimum hnear processor in a quantitative 
sense. The researchers did this by conducting computer experiments to determine the 
ability of an operator and an optimum linear filter to determine a known pattern's 
presence or absence in a noisy image. The performance of both the operator and 
optimum linear filter are recorded as probability of detection, probability of false 
alarm pairs, which the researchers use to determine effective signal-to-noise ratio. 
The performance of man verus machine (optimum linear filter) is compared 
quantitatively using the effective signal-to-noise ratio. Operator and machine/filter 
are tested against circular targets in Random White Gaussian noise and in sattellite 
images. The researchers report that the machine /filter outperforms the man when the 
details of both target and background are known in advance, but the man outperforms 
the machine/filter when the details are known only in a statistical sense. 



TABLE OF CONTENTS 


I. INTRODUCTION .1 

II. EXPERIMENTAL APPROACH . 19 

III. SUPPORTING THEORY. 33 

A. STATISTICALLY RELIABLE EXPERIMENTS. 33 

B. THE LINEAR FILTER . 36 

C. THE OPTIMUM LINEAR FILTER. 38 

IV. PRESENTATION OF EXPERIMENTS AND RESULTS . 47 

A. EXPERIMENT 1: TRANSPARENT TARGETS IN RANDOM WHITE. 

GAUSSIAN NOISE. 49 

B. EXPERIMENT 2; TRANSPARENT TARGETS IN SPOT BACKGROUND ... 51 

C. EXPERIMENT 3; CAMOUFLAGED-OPAQUE TARGETS IN. 

SPOT BACKGROUND. 58 

V. SIGNIFICANGE . 63 

APPENDIX A. CURRENT ATR RESEARCH. 65 

APPENDIX B. EXPERIMENTAL DATA. 77 

APPENDIX C. COMPUTER PROGRAMS. 97 

APPENDIX D. MONITOR DISPLAY .141 

INITIAL DISTRIBUTION LIST.•. . 145 


V 




















VI 




ACKNOWLEDGMENT 


The author would like to thank Prof. David L. Pried for his untiring, patient, and competent 
leadership. He has served not only as an advisor but more importantly as a teacher, counselor, 
mentor, and role model. The author would also like to thank Prof Davis, Colin Cooper, and 
commander Petho for their assistance. 



I. INTRODUCTION 


It would be a major advance in the state of the art to find an algorithm for 
Automatic Target Recognition (ATR) which could consistently perform at the same 
level as a trained human observer who is given the opportunity to leisurely examine 
a small field of view. 

Prof. David L Fried. 

Automatic Target Recognition (ATR) for visible/IR images is a subject of interest to the mil¬ 
itary. A lot of work has been done. A problem exists in that this work progresses in an ad hoc 
manner without a clear theory. Today we do not have the ability to produce ATR hardware for the 
field. We believe this thesis will help provide some of the theoretical basis for future research. 

In Appendix A of this thesis we review some of the work currently being conducted in the 
ATR community. In reviewing the work already done in ATR we noted that it almost completely 
ignores the types of filters which theory does predict should, in a certain sense, be optimum. To 
discuss these filters we reference some basic signal processing theory. In signal processing theory 
when considering Gaussian white noise the matched filter is the optimum filter. When considering 
Gaussian non-white noise the optimum filter is the matched filter Fourier transformed divided by 
the Power Spectrum Density (PSD), and then inverse Fourier transformed. Whether the noise is 
white or non-white, so long as it is Gaussian, the optimum filter is a linear filter. In reviewing the 
ATR work we have noted that it has almost entirely ignored optimum linear filters. 

We began work with the hypothesis that the nature of background clutter is such that a ma¬ 
chine equipped with an optimum non-linear filter would recognize targets in a noisy/cluttered back¬ 
ground better than a machine equipped with an optimum linear filter. We hypothesized that a 
close approximation to the optimum non-linear processor searching for a known type of target in 
a noisy/cluttered background is provided by the human eye/brain, when the eye/brain is allowed 
to operate in a leisurely manner. We assume that after examining a reasonable number of training 
samples the eye/brain combination should be considered to be able to achieve near optimum per¬ 
formance.* If we accept the human as a near optimum non-linear filter this permits us to compare 

* The near optimality of the eye/brain combination is a hypothesis which we will not attempt to prove. It certainly 
seems plausible, and is the underlying hypothesis in current work attempting to develop a neural net machine for 
ATR. In any case the ATR-customer community would certainly be pleased to develop an ATR able to perform 
as well as a human at leisure. The inability of curent ATR systems to match a human’s performance is the 
reason that Dr. Rudolph G. Buser and Alexander Akerman III have said “if an ATR doesn’t work near perfectly 
then the human operators (referring to pilots and image analysts) will just turn the system off.” Accordingly 
we feel quite comfortable in taking the performance capability of the human eye/brain combination working at 
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performance of linear processors (which we know how to implement on a computer) with a near 
optimum non-linear filter (the human eye/brain combination). 

We had expected the human, because of his ability to use non-linear processing, to outperform 
a machine using an optimum linear filter. We undertook to prove that this was the case since we 
could not find a proof in the literature. We have since come to a somewhat different conclusion. 

We conclude that the optimum linear filter matches or outperforms the human surrogate non¬ 
linear filter in both the white and non-white backgrounds when the details of the target are known. 
We also conclude that the human outperforms the machine/filter when the target details are known 
only in a statistical sense. In carrying out this work we came to the following conclusions: 

Conclusions 

1. When the background noise was Gaussian and white the linear filtering process outper¬ 
formed the human, but only by about 0.6 dB. 

2. When the background noise corresponded to satellite (SPOT) imagery of the ground, for a 
well camouflaged target* a human’s performance was inferior (or for small targets, at best, 
equivalent) to that of a machine that used an optimum linear filter. 

3. We observed that a human was able to detect background pattern anomalies of a type which 
we would associate with imperfect camouflage. The machine equipped with the optimum 
linear filter was unable to take note of these anomolies.l 

Conclusion 1 presented no major surprise. The signal processing concept is presumably the 
same for both man and machine. The performance of the man falls short, but only by about 0.6 dB. 
We were pleasantly surprised by the results referred to in Conclusion 2. Although it contradicted 
our original hypothesis, it is seen as a positive result. It tells us what filter to use for optimum (time 
unconstrained) performance when the target is of a known form. This thesis suggests that researchers 
should place more emphasis than is apparently being given to the investigation of optimum linear 


a leisurely pace as our reference point. 

* We consider a well camouflaged target to be one which does not “break” the natural pattern of the background 
clutter but only adds its additional signature component to the image scene. 

t We understand that exploitation of conclusion 2 introduces the “curse of dimensionality,” that there are very 
many target image patterns to be looked for. However, with the regular and exponential growth of the amount 
of computing power that has been seen for the past decade and we feel can be projected for the next decade, 
it seems to us that emphasis in the ATR development problem has to be put on developing an algorithm that 
works well enough. Only then should the major part of the effort be put into getting the algorithm to rim fast 
enough. 

f Conclusion 3 noted above supports our original hypothesis. We feel that exploitation of a non-linear process 
that can imitate a human provides a potentially highly effective approach to the ATR problem. 
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filters. Conclusion 3 indicates that non-linear processing may provide better ATR performance than 
linear processing under the right circumstances. We recommend that researchers further examine 
the human non-linear process in follow-on work. 

We designed experiments to test our hypothesis using the following methodology: 

1. We presume that the eye/brain combination can be as non-linear as optimality requires and 
so can use a human as our surrogate for the optimum non-linear filter. The level of ongoing 
work with (ATR) neural nets and a general consensus in the research literature leads to 
the conclusion that the human eye/brain combination’s performance can be considered to 
be acceptably close to optimum (if allowed adequate time). 

2. We know how to write algorithms for an optimum linear filter and so can put it on a 
machine such as a computer. 

These two items of methodology allow us to conduct a comparison of the linear and non-linear 
optimum filters. Our methodology consists of testing humans (to whom we give lots of time to make 
a decision) and machines against the same class of target/background images. We then compare 
their performance to decide the merit of a non-linear filter. 

The basic experiment consists of two parts. The first part involves showing a human tar¬ 
get/background patterns displayed on a computer monitor and recording his decisions (i.e., the 
human decides if the target is present or if the target is not present). We (or more accurately stated 
the computer operating as the control center of the experiment) uses the operator’s inputs to de¬ 
termine his Probability of Detection (Pd) and his Probability of False Alarm (Pfa)- The Pd and 
Pf.a considered together form what we call a (PD,PFA)-pair. We (i.e., the computer) then conduct a 
similar experiment with the machine/filter using image data sets with the same kinds of background 
and target definition/parameters that were used to generate the images shown to the human. These 
data sets are presented to a separate program in the computer which, based on an optimum linear 
filter and some threshold setting, implements what we call the machine/filter. The machine/filter 
decides if the target is present or not present. From the machine/filter’s decisions we determine 
the machine/filter (PD,PFA)-pair — doing this for various threshold settings. For each threshold 
setting we compute a separate (Pd, Pfa) -pair. When plotted this set of pairs forms a curve called 
the Receiver Operating Characteristic (ROC). 

It is useful to present (PD,PFA)-pairs and the ROC on a specialized graph which we have called 
a probability-probability (PRBPRB) graph. Since the PRBPRB graph is not commonly used we 
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will discuss it in enough detail for the reader to understand the data presented in this thesis. 

The PRBPRB graph shows probability of detection on the vertical axis and probability of false 
alarm on the horizontal axis. These axes are not linearly spaced. They are spaced in such a way 
that any change in probability corresponding to one standard deviation (of a Gaussian probability 
distribution) always represents the same axis length. An example of a PRBPRB graph without any 
data plotted is shown in Fig.l. We use these PRBPRB plots through out the thesis to present, 
analyze and compare experimental results. 

We next discuss the probability concept and some commonly used graphical representations 
which the reader will probably recognize. Fig .2 is a plot on a linear scale of the probability densities 
inferred from a set of samples drawn from a normal distribution. R is the familiar bell shaped curve 
centered at zero. The reason we don’t use it to plot data is that it is difficult to form a comparison 
of experimental results from it. For example, we can not use it to approximate Pd or Pfa- We want 
a better way to graphically present experimental data, which is in the form of (PD,PFA)-pairs. 

Fig.3 shows a plot of cumulative probability densities plotted on a linear scale. The cumulative 
probability densities are generated from the same set of Gaussian normal distribution sample values 
used for Fig.2. The cumulative probability distribution plot has linear vertical and horizontal axes. 
It is also difficult to use these graphs to display (PD,FVA)-pairs nor is it clear how one might use such 
a graph to form an estimate of the Effective Signal-To-Noise Ratio (SA'Peff) that can be associated 
with the (PD,PFA)-pair. 
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0.001 0.01 0.1 0.2 0.5 0.0 0.9 0.99 0.999 4-9s 5-9s 

PFA 


FIGURE 1. PRBPRB Graph. The above figure is a PRBPRB graph 
without any data plotted. The reader may not be familiar with 
the axis convention. The axes are spaced evenly by standard 
deviations of a Gaussian about a mean value of 0.5 at the 
midpoint corresponding to zero standard deviations. 






FIGURE 2. Bell Shaped Curve. The above figure shows a linear 
plot of the probability densities of a random normal 
distribution. It is the familiar Gaussian curve. The results 
shown are based on a set of 90,000 randomly chosen values. 
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FIGURE 3. Cumulative Probability Distribution. This figure 
shows a plot of a cumulative probability distribution plotted on 
a linear scale. The plot has a distinctive S shape. Note that 
probabilities of interest for ATR (values near zero and one) are 
squeezed together somewhere on the nearly horizontal portions of 
the curve. 





For example, try to compare a probability (vertical axis) of 0.99 with a probability of 0.999. 
Examine the plot and you will note that these probabilities appear squeezed together on the nearly 
flat horizontal portion of the graph. The difference in performance of an ATR which achieves a 
(Pd) of 0.999 and one which achieves a Poof 0.99 [given that they both achieve the same (Pfa)] 
is very significant. This inability to adequately represent the significant difference in probabilites 
that are of interest to those researching the ATR problem on a linear graph drove us to use a more 
representative graph. 

Fig.4 shows the same cumulative probability densities of Fig.3 plotted on a graph which uses 
a linear scale for the horizontal axis and a probability scale for the vertical axis (called a LINPRB 
plot). It is easy to see on this graph the difference between probability spacing (vertical) axis and 
linear spacing (horizontal) axis. For instance,examine the point 0.5 on the horizontal axis and the 
vertical axis. On the vertical axis (which is probability spaced) the distances between tick marks are 
evenly spaced by their percent standard deviation from the Gaussian distribution’s mean value (in 
this case 0.5). The effect of plotting the cumulative probability densities of a normal distribution 
on this graph is that they form a nearly straight line as can be seen in Fig.4. The plot also creates 
more “working space” for the interesting probability values near zero and one (i.e., probabilities 
that correspond to desirable PpA^nd Pq respectively). Look at the graph. There is a lot of space 
between a probability with a value of 0.99 and another probability with a value of 0.999. The 
same effect is true for probabilities near zero, which we would be interested in if we wished to 
recognize, for example, the difference between Pfa=10 x 10~^ and Pfa=1.0 x 10~5. The use of 
such a probability scale provides the most useful convention for plotting probability data resulting 
from our experiments. 

The next set of figures illustrates how we compare probability data using PRBPRB graphs. For 
a PRBPRB graph both the horizontal and the vertical axes have probability scales. We mentioned 
earlier that each experiment yielded one operator (PD,PFA)-pair and a set of machine (PD,PFA)-pairs, 
constituting the ROC, as data. We next discuss the presentation of this data. 

In Fig.5 a typical operator (PD,FVA)-pair is plotted. The reader should be able to read the 
operator (PD,PFA)-pair from the graph. Prom Fig.5 we approximate Pd as 0.92 and the PpA as 0.08. 
The reader will note that use of the probability scales provides better resolution of (PD,PFA)-pairs 
than a linear scale. The scale is essentially (usefully) expanded at the places of interest. The use of 
the probability scales provides a convenient way of associating an SNReSwith a (PD,PFA)-pair. 
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FIGURE 4. Cumulative Probability Plot. The same data is plotted 
here as is plotted in Fig.3. The above figure shows the 
cumulative probability distribution plotted on a probability 
scale. This has the effect of straightening the S shaped curve 
appearing on the previous linear plot. Note the curve is a 
straight line with working space at the points of interest, near 
zero and one. 




1e-9 1e-7 1e-5 0.001 0.01 0.1 0.2 0.5 0.8 0.9 0.99 0.999 4-9s 5-9s 7-9s 9-9s 


FIGURE 5. PRBPRB Plot Of Operator (Probability Of Detection., 
Probability Of False Alarm)-Pair. The reader should convince 
himself that the operator probability of detection read off the 
graph is 0.92 and the operator probability of false alarm is 
0.08. This plot also shows the uncertainty in the operator point 
with error lines. The operator(probability of detection, 
probability of false alarm)-pair is marked with an o. The error 
bars, corresponding to plus and minus one standard deviation, are 
the horizontal and vertical lines through the o. 





In Fig.6 we plot machine performance on the PRBPRB graph. In the experiments machine 
data was collected as a set of (PDiPFA)-pairs, each pair corresponding to a different threshold (i.e., 
corresponding to a different balance between missed detections and avoiding false alarms). We 
plotted these (PDjF’FA)-pairs yielding the machine ROC. The ROC is shown as a short curved line 
in Fig.6. 

In Fig.7 we show the results of a hypothetical experiment. Data is shown for a machine/filter 
and for an operator. The results for machine/filter and for the operator are plotted using a PRBPRB 
graph. Without discussing the results of the experiments at this time we point out that better 
performance results in data plotted up and/or to the left corresponding to higher Pd and lower 
Pfa- Weaker performance gets plotted lower and/or to the right — corresponding to lower Pd and 
higher Pfa- For Fig.7 we would conclude that the machine/filter outperforms the operator. 

You might be interested to see the same data plotted on a linear graph. Fig .8 shows this. 
Notice that the points of interest are squeezed together at zero and one, making it difficult to read 
(Fd,-Pfa)- pairs. 

When we consider the comparison of machine performance with operator performance we rec¬ 
ognize that the machine performs better than the operator. We then ask the question “how much 
better?” We can quantitatively answer this question by adopting the technique of associating an 
{SNRes) with a (Pd, PFA)-pair. This SNRqs provides the basis for comparing machine and oper¬ 
ator performance and assessing how much better the performance of one is relative to that of the 



FIGURE 6. PRBPRB Graph Of Machine/Filter (Probability Of 
Detection, Probability Of False Alarm)-Pairs. The above graph 
shows machine/filter (probability of detection, probability of 
false alarm) pairs displayed on a PRBPRB plot. 





1e-9 1e-7 1e-5 0.001 0.01 0.1 0.2 0.5 0.8 0.9 0.99 0.999 4-9s 5-9s 7-9s 9-9 


FIGURE 7. PRBPRB Graph Of Machine/Filter (Probability Of 
Detection, Probability Of False Alarm)-Pairs. The above graph 
shows machine/filter (probability of detection, probability of 
false alarm) pairs displayed on a PRBPRB plot. 
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FIGURE 8. Operator, Machine/Filter Linear Plot. Note that the 
points of interest are clumped about zero and one and are 
difficult to read. The same data is shown as is plotted in Fig. 

7 . 
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The significance of the variable SNReft can best be understood by considering a signal along 
with Gaussian noise with various Signal-To-Noise Ratios (SNR’s). For a given SNR we get a set of 
(Pd,Ffa) -pairs (each pair corresponding to some particular threshold setting) and from such a set of 
(P[ 5 ,Pp^)-pairs we form a curve. Such a curve of {Pd,Pfa) will be a straight line when plotted on a 
PRBPRB graph as a consequence of the noise having a Gaussian distribution. Fig. 9 shows ten such 
[PcijPfa) curves, each curve corresponding to a different target signal strength and thus a different 
SNR. The line farthest down and to the right represents the smallest SNRefc {SNReS=l)- The line 
farthest up and to the left represents the highest SNReff {SNReff=lO). When we examine these 
Gaussian Signal-To-Noise Ratio lines (which we shall call “GLINES”) we see that we can associate 
a (Pd)Rfa) pair with a particular SNRe({- We associate a higher S’NPeflfwith a better receiver 
operating characteristic and better performance. 

We shall use these curves to estimate 5NReff remembering that we must have a (PD,PFA)-pair 
to estimate SNReS- In fact, given any two of the three quantities SNReff, Pd, and Pfa we can use 
the PRBPRB graph to estimate the third. We can read the remaining quantity from the graph. 

We use these PRBPRB graphs with the GLINES to plot {Pd, Pfa) data and infer SNReS 
values from our experiments. We then compare the SNReff of the operator with the SNReff 
of the machine. For instance, in Fig. 10 we have plotted the set of machine (PD,RFA)-pairs (the 
curved line) and the operator (PD,PFA)-pair (the circle) on a PRBPRB graph with GLINES. We can 
approximate from the GLINES that the operator SNReff is about 2.8 and that the machine SNReff 
is about 7.0 (reading the max value). Since these are signal-to-noise voltage ratios the difference 
corresponds to 201ogio (7/2.8) or about 8.0dB. This example shows how the PRBPRB graph with 
the GLINES can be used to approximate the SNReff for both the operator and the machine. We 
use the SNReff as a measure of performance and the dB difference between two SNReff values 
to compare performance — higher SNReff being associated with better performance. We think 
this is an unambiguous and useful technique and recommend that the ATR community consider 
adopting it or some similarly unambiguous technique as a convention for discussing and comparing 
ATR machine/filter performance. 
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FIGURE 9. PRBPRB Graph With Gaussian Equivalent SNR Lines. The 
above figure depicts ten lines corresponding to signal-to-noise 
ratios from one (labelled in lower left corner) to ten (labelled 
in upper left). The horizontal and vertical axes use probability 
scales. 
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FIGURE 10. PRBPRB Plot With Gaussian Equivalent SNR Lines Of 
Operator And Machine Performance. The above graph shows an 
operator (probability of detection, probability of false alarm)- 
pair and a set of machine (probability of detection, probability 
of false alarm)-pairs on a PRBPRB graph with GLINES. The GLINES 
are labelled from the lowest(SNR=1) to the highest(SNR=10). In 
the above example the machine has an effective signal-to-noise 
ratio of about 7.0 and the operator has an effective signal-to- 
noise ratio of about 2.8. Thus the operator performance is about 
8dB down from that of the machine/filter. The PRBPRB graph with 
GLINES is useful for approximating effective signal-to-noise 
ratio, which we use as a measure of performance. 






The SNReffcan also be calculated analytically. The formulaes used to analytically calculate 
SNReff are discussed next. This analytic calculation of SN Red is more accurate than the graphi¬ 
cal approximation. SNReS is calculated analytically from a (Pd. T’F.\)-pair according to the equa¬ 
tion 


SNReff = V2 [erf-1(1 - 2 Pfa) - erf-i(l - 2 Pd)] , (1) 

where the function erf ^(x) is the inverse of the standard error function, erf(x), which is defined by 
the equation 


erf(x) = 



dt exp(—. 


( 2 ) 


The basis for writing Eq. (1) for the (Gaussian equivalent) or SNReft, lies in the consideration that 
if we were dealing with a signal of magnitude s in Gaussian noise with standard deviation a for 
which we can consider that 


SN Reff = s/a , 


(3) 


then if the detection threshold were set at level T we would have 


fT/(aV2) 

PpA = 1 — 2/7r / dt exp ( — , 


(4) 


and 


PD=h 



(T-s)/ioV2) 


dt exp ( — • 


(5) 


We can derive Eq. (1) from Eq.’s (3), (4), and (5). 

Previously when discussing the PRBPRB graphs we approximated the SNResas 3.0 for a 
(Pd, PFA)-pair of (0.92,0.08). We can use this pair and Eq. (1) to analytically calculate SNReR= 
2.8101. We can then see that our approximation is close to the analytic value and suitable for the 
performance comparisons we will make between machine and operator. 
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II. EXPERIMENTAL APPROACH 

We conducted a number of experiments using three types of targets and two types of back¬ 
grounds comparing operator performance with that provided by various types of filters. The three 
target types are referred to as “Transparent,” “Uniform-Opaque,” and “Camouflaged-Opaque.” The 
two background types were “Random White Gaussian (RWG)” and “SPOT” patterns. 

All the targets were disk shaped and nominally uniform across the disk. (We shaped the targets 
as closely as possible to disks given the square pixel array their patterns were fit onto.) Targets had 
some particular level of signal strength above the local average background. This excess of the signal 
strength above the local average background we shall refer to as the target’s signature. 

For the Transparent target the background pattern was altered only by adding the target 
signature to the background value of each pixel “covered” by the target disk. 

For the Uniform-Opaque target each pixel covered by the disc was given the same value, a value 
equal to the target signature plus the average of all the background pixel values covered by the disk. 

For the Camouflaged-Opaque target we used the same Uniform-Opaque target, but then also 
added a camouflage pattern on top of the uniform pattern. We obtained the camouflage pattern 
by randomly selecting a disk shaped region from somewhere else on the SPOT background image. 
From this region we extracted a pattern which was the same size as the target disk and introduced 
a bias to make the (camouflage) pattern thus extracted have a zero mean value. Examples of the 
three target types are shown in Fig.’s 14, 15, and 16. The association of these targets with real world 
target situations is discussed shortly. 

We conducted experiments with (background clutter) noise either generated by the computer (in 
the case of white Gaussian noise) or obtained from satellite imagery of Jacksonville, Fla. (obtained 
from the French SPOT satellite system). We found that for the satellite imagery and Transparent 
target the optimum linear filter operates with an 51VReft ranging from significantly higher than to 
just a bit better than the operator’s — how much better depending on the target size. For the 
“Camouflaged Opaque” target in SPOT background the operator achieves a significantly higher 
51VReft than the machine/filter for all target sizes. 

We generated the two types of backgrounds in the following manner. Random White Gaussian 
(RWG) backgrounds were generated by setting each pixel to the same value, a value between zero and 
one. We then added to the pixels a Gaussian random value with a standard deviation considerably 
less than unity. The choice of the random values added was statistically independent from pixel to 
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pixel. The results were then clipped to lie between zero and one. An example of RWG background 
is shown in Fig. 11. The background pattern thus produced had no identifiable features. 

SPOT images were generated by randomly selecting a small section of pixels from a large SPOT 
image of Jacksonville, Fla. area. Although the background clutter was random, features both man 
made and natural were clearly visible. These features had distinct edges. An example of the satellite 
imagery is shown in Fig. 12. 

We used two different types of filters in the experiments. These were the matched filter and the 
optimum filter. In order to understand these filters the reader must be familiar with some signal 
processing terms. We next discuss the meaning of these terms. A discussion of SNR, Power Spectral 
Density (PSD), optimum filter, optimum linear filter, and matched filter follow. 

The SNR is the ratio of the average of all measurements taken in a set of observations when 
there is a target present, minus the average of all the measurements taken when there is no target 
present (i.e., the target signature), divided by the rms deviation of all the measurements taken when 
the target was always present (or the rms deviation when the target was always absent). 

The use of the term SNR implies the use of some filter and of a sample selection process. Note 
that in defining the SNR we refer to measurements when describing both the signal (numerator) 
and the noise (denominator). In making a measurement some environmental effect (light, heat, 
temperature) interacts with a sensor to produce an array of data that is then input to a filter. 
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FIGURE 11. Random White Gaussian Background. The above figure 
shows an example of Random White Gaussian background. There is no 
target present in this figure. Note there are no identifiable 
patterns (features) in the background. 
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FIGURE 12. SPOT Background. The above figure shows a spot image. 
In this case there is no target present. Note there are clearly 
distinguished patterns (features) in the background. Linear 
filters can not take advantage of the nature of these features 
when deciding if a target is present or not present. 









The filter may be thought of as some algorithm which processes a sequence of sensor output 
values to produce a sequence of filter output values. One output value for each possible source/target 
position with output sampling to correspond with some particular possible source/target position 
of the filter. Though filters are often thought of in terms of the processing of the various frequency 
components of the signal input to the filter it is at least as relevant to think of a filter as acting 
directly on each of the input sample values and it is in that sense that we shall generally consider 
a filter. If the filter is a linear filter then it is equivalent to the process of forming a sum of a 
set of weighting factors, each times one of the input signal sample values. (The sequence of filter 
output values corresponds to the forming of this sum with a sequence of different shifts between the 
weighting factors and the input signal sample values. Taking a single sample of the filter’s output 
corresponds to restricting attention to a single relationship between the weighting factors and the 
input signal sample values.) A linear filter may be considered to be defined by it’s set of weighting 
factors. 

The PSD is the Fourier transform of the covariance of the background pixel values (nominally 
produced by a sensor). The PSD may be considered to define the frequency content of a random 
signal, in this case of the background, that will be part of the signal going into our filter. 

The term matched filter refers to a linear filter which when expressed as a pattern of weighting 
factors may be considered to have the same “shape” as the target’s nominal signal amplitude. In 
the two dimensional work of our thesis the matched filter for our circular target is a disk shaped 
pattern of equal weights, surrounded by a set of weights each equal to zero. 

An optimum filter refers to a filter which when applied to a signal yields the maximum possible 
SNR. It may be linear or non-linear. In the case of RWG noise the optimum filter is known to be 
the matched filter. 

An optimum linear filter is optimum only relative to the maximum SNR produced by all other 
linear filters. It is possible that some non-linear filter can produce a higher SNR than that produced 
by the optimum linear filter. For Gaussian noise that is not white the optimum linear filter is a 
linear filter whose weighting factors correspond to the matched filter Fourier transformed, divided 
by the PSD, and then inverse Fourier transformed. 

We hypothesized that the human eye/brain combination would perform as an optimum non¬ 
linear filter. 

In describing the experiments we conducted we will refer to various target types. This next 
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section discusses each of these targets in one of the previously mentioned backgrounds and describes 
the extent to which these target/background combinations may be considered to be related to real 
world target situations. 

As already mentioned, the experiments used two types of background (RWG, SPOT) and three 
target types. The three target types are referred to as “Transparent,” “Uniform-Opaque,” and 
“Camouflaged-Opaque.” 

We combined these backgrounds and targets in three combinations each corresponding to one 
of the experiments. These combinations were: 

1. Experiment 1. Transparent targets in Random White Gaussian (RWG) backgrounds. 

2. Experiment 2. Transparent targets in SPOT images. 

3. Experiment 3. Gamouflaged-Opaque targets in SPOT images. 

We considered conducting experiments with a fourth combination which was “Uniform-Opaque” 
targets in SPOT images but these targets were too easy for the operator to detect and we didn’t 
believe the experiment would yield any insight to the non-linear filtering process we were investigat¬ 
ing. 

When we refer to Transparent targets we mean targets that added the target signature level to 
the background signal level for each pixel covered by the target disk. The Transparent targets were 
the most difficult targets for the operator to detect. In effect, the Transparent targets had perfect 
camouflage. They did not disrupt the background pattern; they only added a constant, the targets 
signature level, to the background pattern. An example of the Transparent target in both RWG, 
and a SPOT image (the first and second combination) is shown in Fig.’s 13 and 14. 
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FIGURE 13. Random White Gaussian Background With A Transparent 
Target. The above figure shows random white Gaussian background 
with a target present. Look closely at the center of the image, 
the target has a diameter of 21 pixels. 
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FIGURE 14. SPOT Image With A Transparent Target. The above figure 
shows a SPOT image with a target present. Look closely at the 
center of the image. The target which has diameterter of 21 
pixels is just barely perceptable. 
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When we refer to either of the opaque class of targets we mean targets which, when displayed, 
had a uniform signal level. For each pixel covered by the target the target’s signal (the same value 
for all target pixels) was substituted for the background. This created the effect of a uniform 
uncamouflaged target region that was very clearly not part of the background though the target 
pixel value was set to be only just a bit above (or in some cases not at all above) the average of the 
background pixel values covered by the target. The operator could recognize background patterns 
and features and easily decide that the “Uniform-Opaque” target feature was distinctly different 
from these background features. Since the “Uniform-Opaque” target was very easy for the operator 
to detect we did not do any quantitative work with it. An example of the Uniform Opaque target 
in a SPOT image is shown in Fig. 15. 

When we speak of camouflaged targets we refer to targets that are closely matched to but are 
imperfectly camouflaged relative to the Transparent targets. We created the imperfect camouflage 
by generating targets with a uniform signal level as we did with the Uniform Opaque target. We then 
randomly selected a target-size camouflage pattern from somewhere other than the the immediate 
vicinity of the target position and added that camouflage pattern to the uniform target pattern. We 
biased the camouflage pattern so that it had a zero mean signal value — so it did not change the 
target’s average signature. The net effect was a uniform signal target with a nonuniform, zero-mean 
camouflage pattern that was statistically a good match to the background, but did not “join up” to 
the background very well at the target edges. An example of the Camouflaged-Opaque target in a 
SPOT image is shown in Fig. 16. 

We formulated each of these three types of target patterns to correspond (in a loose sense) to 
certain aspects of real world target situations. A description of one example of a real world target 
situation with characteristics corresponding to each target follows. 

The Transparent target could represent a military vehicle (i.e., a tank) giving off an infrared 
(IR) signal. The tank will absorb the IR energy until its temperature equals the mean value of the 
background temperature. That is the tank absorbs and emits energy until it’s temperature reaches 
equilibrium with the surrounding environment. When the tank has some internal heat source (i.e., 
an engine or a space heater) this heat source produces additional IR energy which causes the tank’s 
IR signature to be above the IR signal produced by the mean background temperature. 
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FIGURE 15. SPOT Image With Opaque Target. Shown above is a SPOT 
image with an opaque target. These targets were very easy to 
recognize because the target completely covered the background 
irregularities. We did not do any work with these types of 
targets. 
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FIGURE 16. SPOT Image With A Camouflaged Opaque Target. The 
above figure shows a SPOT image with a Camouflaged Opaque Target. 
Look closely at the center of the background and find the target 
(it is difficult to see) then work your way out to the target 
edges. You will note that the edges don't quite 'match up' with 
the background. 
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Finally if the tank has a reasonably smart crew then they will not park the tank in the open, but 
seek out some natural camouflage. The natural camouflage if it’s like light shrubbery is not solid, it 
also produces IR energy which is added to the overall target signal. The natural camouflage is not 
uniform; therefore, the target will not appear to have a uniform IR signal. Moreover, the nonunifor¬ 
mities have a pattern similar to the background. Each of the IR sources (tank, mean background, 
and natural camouflage) are essentially cumulative. The Transparent target in our experiment treats 
the various background signals and target signal cumulatively. Thus, the Transparent targets in a 
sense simulate many real world target detection situations where the targets have “near perfect” 
camouflage, (i.e., camouflage that blends into the background with no discontinuities). 

Opaque targets simulate a target that has a uniform signal level. An uncamouflaged vehicle 
with a uniform IR emission is an example. For instance a tank in an open field with its hot engine 
off long enough for a uniform temperature distribution to have developed somewhat above that of 
the background. When we displayed the opaque targets to the operator we found that he could 
readily identify them. The operator was able to do this by recognizing the target’s distinct shape 
and the absence of the irregularities characteristic of the background pattern. 

The opaque target itself does not adequately simulate real world situations since it is unlikely to 
find military vehicles uncamouflaged. However, it is not unlikely to find military vehicles imperfectly 
camouflaged. We recognized that the TVansparent targets represented the best possible camouflage 
and the Uniform Opaque targets represented the worst possible camouflage. We therefore decided 
to use a Uniform Opaque target camouflaged with a target sized background pattern in an attempt 
to simulate the case of a well but imperfectly camouflaged target. Again using the military vehicle 
example, consider a tank with a hot engine. The tank crew attempts to camouflage using camouflage 
paint, netting and some type of material to break the outline of the vehicle (such as dead foliage, 
hay or burlap). The crew positions the tank in some naturally concealed position. It is unlikely that 
the crew can find a position such that the natural IR signal of the background perfectly matches 
the IR signal of the tank. The tank absorbs the background heat from the environment and emits 
heat from its engine. The camouflage paint, netting and foliage provide pattern irregularities that 
help the tank to blend with the background. The ability of the crew to successfully match the 
background IR pattern depends on many factors (i.e., crew skill, natural camouflage, preparation 
time, etc). The best the crew can do is nearly perfectly match the background. 

If the crew imperfectly camouflages the vehicle then the IR signal given off by the tank appears 
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as the uniform IR energy from the tank’s engine, the mean background IR energy, and the IR 
energy from the camouflage. The crew’s camouflage attempts break up the uniform signal but can 
not completely disguise it. The camouflage adds additional non-uniform signal which is close but 
imperfectly matched to the background IR pattern. The above mentioned “Opaque-Camouflaged” 
targets represent this case. In the “Opaque Camouflaged” situation we randomly selected the target 
camouflage pattern from some place in the background. Sometimes this camouflage matched the 
background nearly perfectly (a good crew) and sometimes it did not (a poorly trained crew). We 
thought this situation fairly represented an imperfectly camouflaged target. 

In the previous sections we discussed the terminology and data presentation techniques the 
reader needs to understand the experiments. This terminology will be used to describe the experi¬ 
ments and the associated theory. The next chapter discusses some of this relevant theory. 
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III. SUPPORTING THEORY 

This section introduces the theory relevant to the research. We will discuss the theory we 
consider essential to understanding the key aspects of the thesis. This section includes a discussion 
of: 

1. Statistically reliable experiments and the number of trials required. 

2. The definition and properties of linear filters. 

3. Maximum SNR and optimum linear filtering. 

A. STATISTICALLY RELIABLE EXPERIMENTS 

The first point of theory discusses the process we used in determining the number of trials* 
necessary for each experiment to reliably determine probability of detection, probability of false 
alarm and SN Reff • We wanted to make sure we ran enough trials in each experiment so that when 
we calculated a value for 5AReff the rms error associated with this value would not be large relative 
to the value itself and thus make the result unreliable. We decided that the rms error should be no 
more than about fifteen percent of the “correct” answer. 

We evaluated the relationship between number of trials and the standard deviation of the 
experiment’s results for the SN Reft using Monte Carlo techniques. In this Monte Carlo process we 
replaced the detailed procedure for each trial of determining the presence of a target with a randomly 
made choice of whether or not a mistake was made. The random choice was made in a way that 
reflected some expected (pD,PFA)-pair. The choice of this expected (FD>-PFA)"P^ir was somewhat 
arbitrary and reflected our desire to achieve a convenient to work with detection probability and 
false alarm probability (i.e., values not too close to zero or one). The (PdjRfa) values that we used 
where chosen to correspond to a SNR between one and five. 

We then set up a simulation based on some number of trials which we considered using in an 
experiment. A result was randomly chosen for each of these trials. This result was either chosen 
to be correct or incorrect in proportion with the selected probabilities (PdiRfa)- The program first 
took the set of reports from the simulated trials, then calculated the experiment’s Monte Carlo 
(P[ 5 ,PpA)-pair — and from that calculated an SNRefiioT a simulated experiment. 

That simulated experiment was repeated many times and from the results of those many trials 
we obtained a number of SAPeff estimates. Prom these many SAPeflf estimates we determined a 
standard deviation to be associated with a SNR estimate. Having decided that an rms deviation 

* Note when we use the word trial we mean a single detection event. 
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of 15 percent of the SNRed was a satisfactory result, if the standard deviation obtained with the 
simulation was not within 15 percent of the SNRef^we repeated the experiment with an increased 
number of trials in the Monte Carlo simulation. 

We repeated this process for different numbers of trials (50 trials to 500 trials) with {Pd,Pfa)- 
pairs chosen to correspond to SNR’s of 1,2,3,4,5. In doing this we were conscious of the fact that 
if we asked the operator to perform too many trials, then human factors (boredom and annoyance) 
might unduly influence the experiment. We knew from experience that the operator could perform 
about 40-60 trials in an hour and expected that the longest the operator would be able to maintain 
his concentration was about eight hours. We therefore felt that 500 hundred trials was the absolute 
maximum number of operator trials for any experiment. We never ran an evaluation for a larger 
number of trials. 

Shown in Table 1 is a summary of the Monte Carlo simulation results. We decided to use a 
SNReRof 3 and 200 experimental trials. We accepted an rms error of 14 percent. 

The results shown in Table 1 indicate that for a nominal SNR of 5.0 the estimated SNR tends 
to be biased negatively, more so the smaller the number of trials. Even for a nominal SNR of 4.0 
this bias was present at a significant level unless we used more than 100 trials. For our choice of 
a nominal SNR of 3.0 with 200 trials there does not appear to be any bias problem, We also note 
from consideration of Table 1 that for 200 trials we will have close to 15 percent error whether the 
nominal SNR is 2.0,3.0,4.0 - so we do not have to be too concerned about the exact selection of 
signal strength to match the nominal SNR value of 3.0. 

We concluded from this that we could obtain satisfactory results if we ran two hundred trials in 
each operator experiment. (The two hundred trial figure was used only for the experiments with the 
human. For the experiment with the machine/filter we had no comparable constraint on how many 
trials we could run. For the machine/filter part of each experiment we ran ten thousand trials.) 

In setting up the actual experiments we could not explicitly choose the SNR to match that in 
the table. Instead we simply guessed at a suitable signal strength and ran a small number of trials 
with a human and collected {Pu,Pfa) data from which a coarse estimate of SNReH was found. We 
then accordingly adjusted the signal strength and repeated the experiment. After a few experiments 
we converged on a suitable signal strength. This signal strength was then used for both the two 
hundred operator trials and the ten thousand trials for the machine/filter. 
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SNR„„, SNR.rf STDSNR #trials % dev 

1.0000 1.0417 0.5509 50.0000 0.6920 0.3080 55.0905 

2.0000 2.0860 0.6225 50.0000 0.8404 0.1596 31.1245 

3.0000 2.8879 0.5519 50.0000 0.9178 0.0822 18.3974 

4.0000 3.3172 0.3439 50.0000 0.9487 0.0513 8.5978 

5.0000 3.4451 0.1951 50.0000 0.9567 0.0433 3.9022 

1.0000 1.0142 0.3772 100.0000 0.6908 0.3092 37.7221 

2.0000 2.0521 0.4536 100.0000 0.8415 0.1585 22.6817 

3.0000 3.0739 0.5447 100.0000 0.9311 0.0689 18.1567 

4.0000 3.7504 0.4202 100.0000 0.9666 0.0334 10.5039 

5.0000 4.0113 0.2393 100.0000 0.9767 0.0233 4.7862 

1.0000 1.0123 0.3108 150.0000 0.6915 0.3085 31.0778 

2.0000 2.0330 0.3637 150.0000 0.8414 0.1586 18.1870 

3.0000 3.0738 0.4794 150.0000 0.9327 0.0673 15.9787 

4.0000 3.9326 0.4518 150.0000 0.9724 0.0276 11.2950 

5.0000 4.3077 0.2558 150.0000 0.9836 0.0164 5.1161 

1.0000 1.0072 0.2657 200.0000 0.6912 0.3088 26.5662 

2.0000 2.0252 0.3134 200.0000 0.3414 0.1586 15.6719 

3.0000 3.0644 0.4137 200.0000 0.9334 0.0666 13 . 7892 * 

4.0000 4.0062 0.4681 200.0000 0.9744 0.0256 11.7036 

5.0000 4.4853 0.2862 200.0000 0.9867 0.0133 5.7244 

1.0000 1.0060 0.2372 250.0000 0.6913 0.3087 23.7238 

2.0000 2.0263 0.2751 250.0000 0.8422 0.1578 13.7526 

3.0000 3.0521 0.3693 250.0000 0.9334 0.0666 12.3096 

4.0000 4.0453 0.4610 250.0000 0.9757 0.0243 11.5250 

5.0000 4.6112 0.3079 250.0000 0.9886 0.0114 6.1584 

1.0000 1.0033 0.2187 300.0000 0.6910 0.3090 21.8702 

2.0000 2.0190 0.2529 300.0000 0.8417 0.1583 12.6474 

3.0000 3.0428 0.3308 300.0000 0.9334 0.0666 11.0253 

4.0000 4.0712 0.4575 300.0000 0.976 0.0235 11.4387 

5.0000 4.7057 0.3290 300.0000 0.9898 0.0102 6.5793 

1.0000 1.0022 0.1997 350.0000 0.6910 0.3090 19.9726 

2.0000 2.0138 0.2334 350.0000 0.8414 0.1586 11.6711 

3.0000 3.0321 0.3038 350.0000 0.9331 0.0669 10.1254 

4.0000 4.0701 0.4427 350.0000 0.9767 0.0233 11.0664 

5.0000 4.7788 0.3402 350.0000 0.9907 0.0093 6.8031 

1.0000 1.0031 0.1858 400.0000 0.6913 0.3087 18.5840 

2.0000 2.0133 0.2193 400.0000 0.8415 0.1585 10.9668 

3.0000 3.0274 0.2798 400.0000 0.9331 0.0669 9.3251 

4.0000 4.0779 0.4240 400.0000 0.9771 0.0229 10.5998 

5.0000 4.8370 0.3527 400.0000 0.9913 0.0087 7.0535 

1.0000 1.0040 0.1752 450.0000 0.6915 0.3085 17.5158 

2.0000 2.0099 0.2051 450.0000 0.8413 0.1587 10.2564 

3.0000 3.0230 0.2682 450.0000 0.9330 0.0670 8.9388 

4.0000 4.0690 0.4023 450.0000 0.9771 0.0229 10.0564 

5.0000 4.8782 0.3633 450.0000 0.9918 0.0082 7.2651 

1.0000 1.0018 0.1656 500.0000 0.6912 0.3088 16.5635 

2.0000 2.0097 0.1922 500.0000 0.8414 0.1586 9.6123 

3.0000 3.0226 0.2561 500.0000 0.9331 0.0669 8.5362 

4.0000 4.0631 0.3864 500.0000 0.9771 0.0229 9.6611 

5.0000 4.9177 0.3692 500.0000 0.9922 0.0078 7.3837 


Table 1. Table Of Monte Carlo Simulations. The above figure .shows 
the relationship between the nominal signal-to-noise ratio 
(SNRnon,), the effective signal-to-noise-ratio (SNRgff) , the 
deviation of snrnom (STDSNR), the number of trials (# trials), 
the effective PD (PD^jj) , the effective PFA (PFA^ff), and the 
standard deviation expressed as a percent (% dev). In our 
experiments we used SNRnom=3.0, and 200 trials (this row is marked 
with an asterisk). We accepted about a 14% standard deviation in 
the estimate of SNR^ff that an experiment will produce. 
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B. THE LINEAR FILTER 

The second point in the theory that I will discuss concerns the concept of a linear filter. The 
basic property of a linear filter is that when it operates on two signals added together it produces 
a result equal to the sum of what it produces when acting on each signal separately. This is shown 
below with F{...) denoting the filter and X, Y denoting the two signals. If F is a linear filter then 

F{X+ Y) = F{X) +F{Y). (1) 

As a corollary we also have that if a is a scalar constant then 

F{aX) = aF{X). (2) 


It may be seen from this that in linear filter processing of a signal the “significance” assigned 
to any portion of the input signal in forming the output can not depend on the value of any other 
portion of the input signal. (This follows from the recognition that we may consider the two portions 
of the input signal to constitute two separate signals X and Y which when added together as X + Y, 
form the actual input. Clearly the value of one, say Y, cannot influence how we treat the other 
value, namely X.) It thus follows that a linear filter’s output may be expressed as a weighted sum of 
the input values. If the input signal is a sequence of sample values, Aj where i is (...—2, —1, 0,1,2,...) 
then the sequence of filter output sample values , Xk, may be written as 

OO 

Xk= (3) 

j=—oo 

where the set of values, Fj, is the set of weighting factors which define the filter. 

Going from the discrete to the continuous we can then write that if the input signal is a function 
of some variable, say of time t, and so is expressible as X (t),then the continuous output of the filter, 
X{t), is given by the expression 

/ OO 

dt' F{t')X{t-t'). (4) 

•OO 

This is the spatial domain (or time domain) convolution version of the linear filter process. 

Eq. (4) represents the convolution of the filter function, f (f), with the function X{t) . 

With suitable use of Fourier transforms an alternative form of the filtering process can be 
written. 



dt exp{—2irift)F{t), 


36 




Xif)^ 

poo 

/ dt exp(— 27 ri/t) X (t), 

1 — OO 

F{t) = 

pOO ^ 

/ df exp(2TTift) F{f), 

/ — OO 

X{t) = 

pOO ^ 

/ d/exp( 23 ri/t) X(/). 

1 — 00 


Eqs. (5) are the mathematical expressions for the Fourier transforms and the inverse Fourier trans¬ 
forms in the time and frequency domains, respectively . We use the tilde notation, as in X{f), to 
denote the Fourier transform of the function, in this case X (t). The alternative form of the filtering 
process is derived next. 

The repeated Fourier transform is known to have the property that for any well-behaved function 
G{p) we can write 


G(p) = 



dp' dqexp{±2Ttiq{p — p'))G{p). 


( 6 ) 


We will use Eq. (6) in the derivation without offering proof. Replacing F{t) and X{t — t') with the 
associated Fourier transforms in Eq. (4) we get 


/ OO rOO poo ^ ^ 

dt' d/exp(27ri/t') / df'exp{2%if'{t - t'))F{f)X {/') 

•OO J — oo J—oo 

/ OO poo poo _ _ 

df / df' dt' — f't' + ft'))F{f)X{f') 

•OO J — oo J — oo 

/ OO pOO pOO ^ 

df df' dt'exp(27rit'(/-/'))exp(-27ri/'t)F(/)X(/') 

OO J — oo J — oo 

/ OO ^ ^ 

df F if) X if) exp(27rz/t). 

•OO 


(7) 


Eq. (7) is the frequency domain version of the filter process for a linear filter, where F(/) 
represents an alternate form of definition of the filter function, the frequency domain version 
of the filter function. It is equal to the Fourier transform of the weighting factor or convolution 
version of the filter function, F(t). 
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C. THE OPTIMUM LINEAR FILTER 


This next section discusses the optimum linear filter. An optimum linear filter operates on a 
signal in such a manner as to produce the highest possible SNR that any linear filter can provide.* 

It is our aim in this section to develop an expression for the optimum linear filter. For simplicity 
we will develop the expression in one dimension. The extension of this proof to two dimensions is 
straight forward; it only requires a bit more algebra. 

We intend to represent the signal as S{t). Both the target and the background contribute to 
the total signal such that 

S{t) = s{t) + n{t). (1) 

Here s(t) is the target signature and n{t) is the background signal. n{t) can be considered to be 
equal to a random function of unit rms amplitude, u(t), multiplied by a scaling constant, No, so we 
have 


n{t) = Noi/(t). (2) 

The function i/{t) has the following properties and associated quantities. 

* In order to organize nomenclature for the reader’s easy reference we list here the terms required for this proof. 

P(t) = One dimensional representation that describes a target, 

P(f) = Fourier transform of P(t), 
s(t) = So P(t — to); Target signature, 
s{f) = Fourier transform of s(t), 
n(t) — Noise associated with the target signal, 

Ti(/) = Fourier transform of n(t), 

P(t) = Linear filter, 

F(/) = Fourier transform of P(t), 

Pop(t) = A linear filter which we will prove is optimum, 

Fopif) = Fourier transform of Pop{t), 

SF(t) = Filter that consists of functions orthogonal to Fop{t), 

SF(f) = Fourier transform of SF{t), 

S(t) = Filtered background &: target signal in the time domain, 

s(t) = Filtered target signal in the time domain, 

n(t) = Filtered background noise signal in the time domain, 

r'(f) = Function of unit strength which describes the background characteristics, 

uif) = Fourier transform of i'(t), 

No = Weighting factor which when multiplied by i>{t) describes the background, 

Cv{t) = Covariance of the background signal, 

3>i/(/) = Power spectral density. 
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1. Its ensemble average is zero, so we can write 


From this it can be seen that 


(u{t)) = 0. 
(n(t)) = 0. 


2. Its Fourier transform is expressed as 

/ OO 

dt exp{~2iTift) v{t) . 

•OO 


that 


(3) 

(4) 

(5) 

( 6 ) 


/ OO 

dt exp{—2Trift)n(t). 

■OO 

3. It’s characterized by the correlation function with 

Cuit) = (t'it — (7) 

4. It has a power spectral density, 4»^(/), which is the Fourier transform of Ci^(t), so that 




( 8 ) 

(9) 


dt exp(—27ri ft) Ct/{t). 

J-OO 

We will let 

s{t) = So P{t — to), 

represent the signature of the target. Here P(t) describes the normalized target signal form. It’s 
normalization is expressed as 

/ OO 

dt|P(t)|2=l. (10) 

■OO 

It’s Fourier transform is 

/ OO 

dt exp{—2xift) P{t). (11) 

•OO 

The quantity 5o may be considered to be a measure of the target signal strength, and to may 
be considered to define the target’s “location/position” , or time of occurrence. The frequency 
transform of the signal can be written 

/ OO 

dt exp(—27ri/t) s{t) 

•OO * 

dt exp{—2xift) So P{t — to) 


/ OO 

dt exp{—2xift) P(t — to) 

•OO 

/ OO 

dt exp(— 27 ri/f) P{t — to) exp(27ri/to) exp(— 27 ri/to) 

•OO 

/ OO 

dt exp(—27ri/(t — to)) P(t — to) exp(—27ri/to) . 

•OO 


( 12 ) 
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We shall let t' = {t — to), and with that we have dt’^^dt. This allows us to write 


/ OO 

dt' exp(—27ri/t')P(t') 

•OO 

= 5oexp(-27ri/to) P(/). 


(13) 


We can now write 


5(/)= / dt exp{~2nift) S{t) 

J — OO 

/ OO 

dt exp{—2nift) [s(t) + n(t)] 

•OO 

= s(f) + n(f). (14) 

We have expressions for the background and target signal Eqs. (2), (6), (9), and (13) — and 
the associated Fourier transforms. We next develop an expression for filtered signal. The filtered 
signal, which we denote by S{t), can be written in accordance with Eq. (14) as 

/ OO ^ 

df exp{2jift)F{f)S{f) 

•OO 
0 

df exp{2Trift) F{f){I{f) + n(/)] 


-L 


-OO 

/ OO ^ pOO ^ 

df exp{2'Kift) F{f)s{f) + df exY>{2nift)F{f)n{f). 

•OO J — oo 


(15) 


If we write: 


then we get 


/ OO ^ 

df exp(27ri/f) F{f)s{f), 

•OO 

/ OO ^ 

df exp{2nift) F{f)n{f), 

•OO 

S{t) ~ s(t) +n{t). 


It is easy to see that the expected value of the filtered signal taken at time to is 


and from Eq. (4) have (^n{to)) = 0, so 


5(to) = s(to) +n{to), 

(S{to)}= (s(to)) 

= s{to). 


(16) 


(17) 


(18) 


(19) 
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This allows us to write for the random noise 


|n(to)| = |■S'(^o) - s{to)\. 


( 20 ) 


so that the mean square, or noise power, is: 

(|n(to)|"> - <|5(to) - «|'>. (21) 


Since the mean signal power is 

(Sito)f 


( 22 ) 


the signal-to-noise power ratio, SNRp, is: 




(Sito)f 

(|ra(fo)P) 

mtor 

(Nto)P>. 


(23) 


We are now ready to consider the form of our filter. We work with a linear filter which, in 
frequency domain form we shall denote by F{f). Our objective is to choose a filter form which 
maximizes the signal-to-noise power ratio, SNRp. We intend to show that the optimum filter is of 
the form 


Fopif) = 


P*{f) 

^M) 


(24) 


But for the moment we simply condider this to be some “arbitrarily” chosen filter form with 
no established virtue. We will do our analysis considering a more general filter form, namely 


F{f) = Fopif) + ^F{f). (25) 

We intend to show that when <5F(/) = 0 the filter F(/) provides the largest possible value for SNRp. 
This will show that Fopif) 1® Ih® optimum filter. 

Before proceeding any further with the analysis we need to take note that if Fopif) has some 
particular virtue as a filter then so does (1 + a)Fopif) • [ For the latter the output signal is larger 
by a factor of (1 -1- a) , but so is the rms noise in the output. Therefore the signal-to-noise-ratio is 
unchanged by the presence of the factor of (1 + a) ]. This means that for our proof of the optimality 
of Fopif) restrict the possible forms of SFif) to functions that are not expressible as aFopif). 

In order to impose this restriction in an analytic form it is convenient to consider an orthogonal set 
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of functions one of whose members is Fop{f), and then restrict 6F{f) to some weighted sum of all 
the other functions in this orthonormal set. We shall choose the orthonormal set to be orthogonal 
on the domain [— 00 , + 00 ] , with a weighting function corresponding to the power spectral 

density of the noise.The orthogonality of any two functions in our set, can be expressed as 

The orthogonality of Fop{f) with respect to all of the other functions in the set and the fact that 
6F{f) is formed as a weighted sum of all those other functions means 


/: 


d/F* (/)£F(/)4>,(/) = 0. 


(27) 


We can write the expression for the filtered signal at time to as 


s{to) 


df exp(27rz/to) Fop{f) 5oexp( 


— 00 
■00 


-2nifto)P{f) + J 


df exp(27rz/fo) 6F{f) Sq ex'p{-2TTifto)P{f) 


/ OO pOl ^ 

df exp(27rz/(to - to)) Fopif) SoP(f) + df exp(27rf/(to - to)) SFif) SoPif) 

•OO J — c 

/ OO ^ rOC 

df Fopif) SoP if) + dfSF if) SoPif) 

■OO J — OO 




and since 


df Fopif )Pif) + So 


/ OO 

df6Fif)Pif) 

•OO 


P*if) = FopimAf) 
hf) = F'opim.if) 


(28) 

(29) 

(30) 


we can write 


■/: 


s(to) = 5o / df F*^if)F^if)^^if) + So J d/F4(/)5F(/)$,(/) . 


(31) 


But remember the integral of the optimum linear filter and the combination of orthogonal filters is 


zero 


Therefore: 


/: 


dfF*if)6Fif)^M) = 0. 


(32) 


=/. 


?(fo) =So / df F:pif)FopimM) + 0 

P*if)Pif) 


--So 

--So 


L 

L 


00 

00 


df^ 

df 


00 ^uiD^vif) 

1%)P 


^Af) 


Mf)- 


(33) 
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This is the numerator in our expression for the signal-to-noise power ratio, SNRp. 

We next develop the expression for average filtered noise the denominator in the signal-to-noise 
power ratio expression. Starting from the expression for the noise power (|h'(to)|^) given in Eq. (21), 
we can write 


(|n(to)|^) No J df exp(27ri/to) Eop(/)i/(/) 


+ ^oj exp(27ri/to) 8F{f)u{f) 


No J df exp(27ri/to)f’op{/)'^(/) 


/ OO ^ 

df exp(27ri/fo) 8F{f)v{f) 

■OO 

/ OO ^ 

df' exp(27rf/'io) Fop{f')v{f') 

•OO 

/ OO ^ 

df' exp{2Trif'to) 6F{f')'u{f') 

•OO 


+ No 


Recalling the form of Fop{f) we have: 


Fop{f)Mf)=P*(f)> 
Fopif)* Mf) = Pif)- 


Substituting this into Eq. (33) we get 

{mo)\^)=([NoJ_ 


p*(f) ~ 

No I df exp(27ri/fo) ~ v{f) 


No 


^u{f) 

/ OO ^ 

df exp(27ri/to) 8F{f) F{f) 

■OO 

rOO P*{f') 

/ df' exp(27ri/'to) ~ v{f') 

7-00 ^u{f') 

— T 

df' ex.p{2Tcif'to) 5F{f')v{f')'^ 

OO 

Making double integrals of the product of integrals we get. 

(|n(to)|^) = No^ j [ dfdf' exp (27ri(/ - /')<o) ~ (^(/)^*(/')> 

7-00 7-00 ^u{f)^Af ) 


P*if)6F*if') 

Mf) 




/ OO rOO 

/ d/ d/' exp (2ni{f - f')to) 

•OO J — oo 

+No^ [ [ dfdf exp (27rz(/ - /')to) ^ {^{fVU')) 

J — ooJ~oo } 

/ OO ^oo ^ ^ 

/ d/d/' exp (27ri(/ - /')to) 5E(/) 6F*if) 

•OO J — oo 


(34) 


(35) 

(36) 


(37) 


( 38 ) 
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It is known that * 


/ CXD 

dtCu{t) exp(-27ri/t) ff(/) = 

•oo 

where g{f) is any well behaved function. Eq. (39) is now applied, yielding the result that 

(|n(to)|2) =No'^ j df + No^ j df P*{f)SF*if) 

J-OO d>!/(/) j-oo 


( 39 ) 


+ ^o 


i: 


df P{f) SFif) + iVo^ / df \8F{f)\H^{f). 


(40) 


We shall now, again use Eq.’s (29) and (30) make this substitution then take advantage of the 
orthogonality of Fop(f) with respect to all other filters to determine that the middle two integrals 
in Eq. (40) zero. Thus the expression for filtered noise is. 

<|n(to)|2) = V / + 0 + 0 + df\dF{ff\l^{f) 

J-OO J-OO 

= No^f df^-^^ + No^f df\SFiff\^M)- ( 41 ) 

J-OO ^u{f) J-OO 

We now have expressions for filtered signal and filtered noise and can express the signal-to-noise 
power ratio in terms of Fop(/) and the filters orthogonal to Fopif). 

The derived expression for the filtered signal-to-noise power ratio is; 


SNRp 


[^(^o)P 

(l™(fo)P> 


5o 


iL 


df 


\pif)\‘ 

4 >.(/) 


2\2 


No' 






L 


df\6Fif)\HM) 


(42) 


For the signal-to-noise-ratio to be as large as possible the denominator in the above equation 
has to be as small as possible. The smallest possible value for the denominator occurs when the 
second term is zero.! 


* D.L. Fried, ’’Spectral and Angular Covariance of Scintillation for Propagation in a Randomly Inhomogeneous Medium", 
Appl. Opt. 10, 721-731 (1971); Appendix 

f This is true because none of the terms in the denominator are negative; 

3’v(/) is everywhere positive, 

|P(/)|2 is everywhere positive, 

|^F(/) |2 is everywhere positive. 
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The second term is zero when SF{f) = 0. Recall that we began this proof by examining a filter 
combination which was the sum of the filter Fop{f) and an orthogonal filter . We have just concluded 
that this filter combination yields the maximum signal-to-noise power ratio when the orthogonal filter 
is equal to zero. Therefore the filter combination which yields the maximum signal-to-noise power 
ratio and is the optimum filter must be Fop{f) alone, which we represent by writing 


F{f) = Fop{f) + 6F{f) definition, 

(43) 

6F{f) = 0 to maximize SNRp , 

(44) 

F(f) = Fopif) the optimum filter . 

(45) 


This completes our proof. 
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IV. PRESENTATION OF EXPERIMENTS AND RESULTS 

This section discusses the experiments and highlights the results. In three types of experiments 
we tested a human subject’s performance and a machine’s performance under a variety of target 
and background conditions. The three experiments are characterized as follows: 

1. Experiment 1: Transparent target in Random White Gaussian (RWG) noise. 

2. Experiment 2: Transparent target in SPOT background. 

3. Experiment 3: Camouflaged-Opaque target in SPOT background. 

All of the experiments used a UNIX computer to generate pixel representations of a roughly 
circular target in background noise. The programming language was MATLAB. 

Each experiment consisted of two separate processes. The first process displayed pictures on the 
computer monitor and was designed to obtain operator input. The second process digitized image 
data and presented this data to the machine/filter, which applied the optimum linear filter. This 
second process was designed to test how a machine/filter (using the optimum linear filter) would 
perform. At the end of each process the computer program that was “responsible” for the conduct 
of the experiment obtained, and stored the operator or machine data and displayed this data on a 
PRBPRB graph for assessment of SNRefj. 

The operator process consisted of a series of statistically independent trials. For each trial the 
subject was told the nominal location of the target but not whether the target was actually present 
in that trial. Thus the operator did not have to search for the target; he only had to decide if it 
was present. In each trial the targets had a probability of one half of being present, but only the 
computer program conducting the experiment “knew” for certain whether or not the target was 
actually present in that trial. The operator was subjected to no time limit in deciding whether or 
not the target was present. In experiments one and two the targets were Transparent so as to achieve 
perfect blending of their pattern with the background pattern. In experiment three the targets were 
opaque and used a camouflage pattern that, while statistically equivalent to the blended background 
pattern, did not smoothly join with the surrounding background at the target edge. 

In order to provide a more operator friendly image display we displayed the image in several 
forms, side-by-side, each with a different gray-scale rendering. We felt that showing more than one 
gray-scale rendering was appropriate since in many real world applications an operator could control 
the intensity and contrast of the display monitor. For instance a radar operator, or the person viewing 
a FLIR display, generally has control knobs to adjust the display’s contrast and brightness. In our 
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experiments we showed eighteen different gray-scale versions of the target/background images. The 
same image data (background signal and target signal) was present in each of the eighteen pictures 
in the monitor display. Thus if a target was present in a given trial then each of the eighteen pictures 
contained target signal, or if the target was not present in a given trial then none of the eighteen 
pictures contained target signal. Each of the 18 display pictures used a different transformation to 
prepare the pixel values for display. In making his decision as to the target’s presence the operator 
was free to consider any one (or even several) of these eighteen versions of the image. In the 
experiments the circular target region had a slightly greater signature value if the target was present 
than it had when the target were not present (unless the target had zero signature, as in Experiment 
3). The targets thus appeared slightly brighter to the operator than the surrounding background. 

After we obtained the operator data we ran the second process which we designed to measure 
the machine/filter’s performance. We used the same background and target definitions/parameters 
for the machine/filter as we did for the operator. The machine/filter decided whether targets were 
present or not present based on the filter output compared with a threshold value. Results were 
obtained for a variety of threshold values (actually for 100 different threshold values). Just as the 
operator knew where the target would be if it was present we also allowed the machine to have 
this knowledge. Accordingly the filtered signal output was taken only for the single sample output 
corresponding to the target’s nominal location. The target present/not present decision was made 
by the machine by applying a threshold to this filter output value. 

The experiments recorded both the operator and machine data then plotted the (fb,PFA)-pairs 
on a PRBPRB graph as discussed in Chapter I. Operator data was collected over 200 trials leading 
to a fourteen percent standard deviation in the SNReft. Since machine data could be collected more 
rapidly, it was collected over 10,000 trials. Each (ft),fVA)-pair plotted was computed using results 
from 10,000 trials for the machine/filter or 200 trials for the operator. 


48 



A. EXPERIMENT 1: TRANSPARENT TARGETS IN RANDOM WHITE 

GAUSSIAN NOISE 

This experiment used Transparent targets in Gaussian random background noise. The target 
region had a slightly greater signal value if the target was present than when the target was not 
present. If the target was present it was greater by the target signature value. In the random 
background pattern this signature was not always enough to provide a clear indication of the target’s 
presence. An example of the monitor display shown to the operator is enclosed in Appendix D. 

We found that the machine achieved a SNRegneatT the theoretically predicted value for a 
linear filter. The operator very closely matched the machine/filter’s performance. The operator 
performance in this experiment seemed to lend credibility to our belief that the operator can act as 
an optimum (non-linear) filter (see Fig. 17). These experimental results were not surprising for the 
machine/filter since a Gaussian “white” background is an ideal case for the optimum linear filter. In 
this case theory predicts that the machine/filter performance will be optimal and should correspond 
to the GLINE of appropriate signal strength. The best we expect the operator to do is match the 
machine/filter’s performance. We were somewhat surprised by how close the operator performance 
did match the machine/filter’s performance. As can be seen in Fig. 17 the operator’s performance 
was down from the machine by less than 1 dB (actually about 0.6 dB). We interpreted this as strong 
evidence that the operator could act as an optimum non-linear filter. In this experiment we did not 
expect the optimum non-linear filter (the operator) to outperform the optimum linear filter. We felt 
that since the RWG noise had no distinguishable features the operator’s ability to process the image 
non-linearly would not give him any advantage over the optimum linear filter. We were plesisantly 
surprised by the experimental results. 
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PFA 


FIGURE 17. Experiment 1. The above PRBPRB graph shows the 
results of the Experiment 1. Note that the machine performs at 
the theoretical effective signal-to-noise ratio of 3.0. The 
operator's performance is very close to this value, lending 
credibility to the assertion that the human eye/brain is an 
optimum (non-linear) filter. 
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B. EXPERIMENT 2: TRANSPARENT TARGETS IN SPOT BACKGROUND 


This experiment utilized Transparent targets in non-Gaussian random noise. We used SPOT 
images of Jacksonville, Fla. for the background/noise. We loaded these images as gray-scale rep¬ 
resentations which we displayed on the monitor. An example of the monitor display with these 
target/backgrounds is displayed in Appendix D. We varied from where in the scene we chose the 
portion of the background that was used for each detection trial so that operators didn’t become 
familiar with what was presented. The experiment obtained (PD,PFA)-pairs for the operator and 
for the machine. Two different machine filters were utilized. Filter 1 was the optimum linear filter 
and filter 2 was a matched filter. Because the background pattern/noise had a PSD that was not 
constant the matched filter is different from the optimum filter. Results for Experiment 2 are shown 
for a small diameter (D=l pixel, a point target) in Fig. 19 and a large diameter (D=21 pixels) target 
Fig. 18. This experiment produced very interesting results. We found that a human outperformed 
the machine by a substantial amount only if the machine used the matched filter. However, we 
also found that the machine equipped with the optimum linear filter consistently outperformed the 
subject except when working with the smallest targets. These results have significant impact. They 
indicate that a machine equipped with an appropriate filter can detect targets better than a human 
when the target signature is well known. Automatic target recognizers may eventually outperform 
humans under the right circumstances. We want to emphasize that the results of this experiment 
contradicted our hypothesis. We found no indication that there was any benefit to non-linear pro¬ 
cessing from these results. Although our hypothesis seemed to be incorrect, we saw the results as 
positive and potentially useful. The results clearly pointed to the merits of optimum linear filtering. 

We were intrigued by the results of this experiment and decided to analyze the optimum linear 
filter in an effort to understand and explain it’s success. We first examined the PSD. Fig. 20 is a 
logarithmic plot of PSD (vertical axis) versus spatial frequency (horizontal axis). We noted that 
PSD fell off rapidly with increasing spatial frequency. You may remember that the optimum linear 
filter divides the Fourier transform of the matched filter by the PSD. The fact that PSD is much 
larger at lower frequencies tends to deemphasize the low frequency content of the matched filter 
and weight more heavily the high frequency portion. This effect is something like differentiation. 
Dividing by frequency in the frequency domain is the same as differentiating in the spatial domain. 
This tends to emphasize the region in the vicinity of the target edges. The Army Research Lab and 
others (see Appendix A) are currently attempting to field an ATR using a form of edge detection. 
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We believe that work is in a sense similar but not the same as optimum linear filtering. We think 
that work may benefit from a closer look at optimum linear filtering rather than thinking directly 
in terms of edge detection. 

We further examined the edge characteristics of the optimum linear filter by examining it’s 
pixel values (which may be thought of as filter weights). Fig. 21 is a three dimensional plot of the 
optimum linear filter for a matched filter with a diameter of 21 pixels. Examine the figure and you 
will note that the pixel value maxima are associated with the edge region. To show this more clearly 
Fig. 22 shows the pixel values associated with the diagonal of the spatial frequency plane. It also 
shows spikes for the pixel values corresponding to the filter edge region. 

The results of this experiment indicate that optimum linear filtering may have strong correlation 
to edge detection. We recommend that researchers doing edge detection work take a closer look at 
the theoretical basis for this type of detection. We think optimum linear filtering is a good place to 
start. 
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PFA 


FIGURE 18. Experiment 2, Diameter = 21. The above graph shows 
the results of Experiment 2. The results were obtained using a 
target whose diameter was 21 pixels (a large target). Note that 
the machine when equipped with the optimum filter significantly 
outperforms the operator at detecting these relatively large 
targets. 


53 




le-9 le-7 1e-5 0.001 0.01 0.1 0.2 0.5 0.8 0.9 0.99 0,999 4-9s 5-9s 7-9s 9-9s 


FIGURE 19. Experiment 2, Diameter=l (A Point Target). Note that 
the man and the machine/filter achieve equal performance. This is 
significant because it illustrates that at best the operator's 
performance will equal the machine/fliter. Operator performance 
even for a very small target signature did not beat the machine. 







spatial freq (f) 


FIGURE 20. Power Spectral Density Plot. The above graph is a 
logarithmic plot of the SPOT background's power spectral density 
(vertical axis) versus spatial frequency (horizontal axis). Note 
that the power spectral density decreases rapidly with increasing 
spatial frequency. 





FIGURE 21. Mesh Plot Of Optimiam Linear Filter. The above figure 
shows a three dimensional plot of the optimum linear filter. The 
spikes correspond to pixel values and the plane parallel with the 
floor corresponds to the spatial frequency axes. Note that the 
pixel values are at their maximum values from pixels 15 thru 20 
then again from pixels 35 thru 40. This has the effect of 
emphasizing (applying a greater weight to) the pixels at the 
target edge region. 










FIGURE 22. Plot Of Pixel Values Along Diagonal. The above figure 
shows the pixel values(vertical axis) plotted against the 
diagonal of the spatial frequency plane. The graph allows us to 
approximate the number of pixels (horizontal axis) associated 
with some pixel value (vertical axis). Thus we can see that 
there are approximately six pixels associated with two vertical 
spikes (maximum filter weights). If you look at the horizontal 
axis you see that these spikes occur at pixels (17-20) and (31- 
34). These pixels correspond to the filter edge region. This plot 
shows that the optimum linear filter applies the greatest filter 
weight to the filter (and target) edge region. 
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C. EXPERIMENT 3: CAMOUFLAGED-OPAQUE TARGETS IN SPOT 


BACKGROUND 

This experiment used camouflaged targets in a SPOT image. We found that the operator easily 
recognized the targets. Even though the camouflage pattern on the target was statistically equivalent 
to the nearby background pattern, the mismatch between the features in the camouflage pattern 
and the adjacent background features, particularly along the target’s edge was a dead giveaway. 
Even with zero target signature the operator was able to reliably detect the presence of the target 
because of the camouflage/edge mismatch. This is remarkable performance, especially when we note 
that the machine/filter has a very poor ROC for the same set of background and target definitions 
and parameters. The results of this experiment for a signal strength of two and of zero are shown 
in Fig.’s23 and 24. The operator outperformed the machine in both cases. Shown in Fig. 25 is the 
Camouflaged-Opaque target,with zero signature, in SPOT background. Note that you can readily 
identify the target because it looks “different” than the background. This target “looks” exactly the 
same as the background to the machine/filter because the camouflage has zero bias and the target 
has zero signal. This is why we think non-linear processors will outperform linear filters when only 
the statistics of the background and target are known. 

These experimental results more closely match the original hypothesis. They provide strong 
evidence that the operator is using a non-linear filtering process to take note of information which 
the machine/filter cannot use. The question of what processing the subject uses to recognize the 
targets deserves further investigation. It was not pursued in this thesis. We think the operator might 
pay particular attention to (i.e., give principle weighting to) the target and background camouflage 
match, particularly at the target background boimdary. We believe an investigation of the decision 
process that the operator goes through in recognizing a target will yield a high payoff. 
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FIGURE 23. Experiment 3, Signal = 1.5. The above figure shows 
the results of Experiment 3. In the above experiment the target 
had a signal of 2. The signal strength did not seem to be the 
most important target characteristic for the operator. The 
operator seemed to look for the mismatch between the target and 
the background camouflage. Note that the operator outperforms 
the machine. 
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FIGURE 24. Camouflage Opaque Target With Zero Signal. Note that 
the operator achieves a signal-to-noise ratio effective of 3.1 
with zero signal. The operator cannot be using linear filtering 
because the target and the background have the same signal and 
therefore look exactly the same to a linear filter. 
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FIGURE 25. Camouflaged-Opaque Target With Zero Signature. The 
above image shows a Camouflaged-Opaque Target in a SPOT 
background. This target has zero signature. You can recognize 
the disc shaped target by the difference in target and background 
features. You take advantage of the fact that the target 
"doesn't look right". A linear filter cannot recognize the 
difference between the target and the background because they 
both have the same signal level. 
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V. SIGNIFICANCE 


In this chapter we discuss the thesis results and their significance. We believe that the proposed 
ATR systems which we know of can benefit from our research results and analysis. We make the 
following observations and recommendations. 

We recommend that ATR researchers adopt comparison of the machine/filter device under 
study with a human operator’s performance under the same tar get/background characteristics as 
the standard to evaluate how well the machine/filter performed. We found only one other example 
where this was done in a quantitative sense. This is an important approach and although our 
research indicates that a human may not be the best possible filter in all situations, a system able 
to match human performance would have many customers. An ATR as good as a man operating 
at his leisure would be of great interest and would represent a significant enhancement to combat 
capability when fielded. 

The methodology we adopted of associating {Pd,Pfa) together as a pair and using this pair 
to calculate an SNReS, and then using this SNReSSiS the standard of comparison is unambigu¬ 
ous and provides a powerful comparative tool. The research we have read often fails to associate 
Pd with Pfa when reporting system performance. Commonplace statements such as “The system 
has demonstrated its ability to reliably detect targets” together with the remark that “The false 
alarm rate needs to be improved” are ambiguous to the point of being meaningless. Any system 
can reliably detect targets if you’re willing to tolerate the associated false alarms. The ATR com¬ 
munity should adopt the convention of associating Ppand Pfa together as a pair. The methodology 
of reporting Powith Pfa as a pair then reporting a system’s performance as the Gaussian equivalent 
signal-to-noise ratio (SAPeff) of that (PD,PFA)-pair may be used to compare the performance of 
any two systems, or to compare any system with a human. * 

We have examined much work in the ATR community which attempts to use edge detection as 
the underlying process for target recognition. The results of this work appear promising. We believe 
that the optimum linear filter taking proper account of the background represents the appropriate 

* Some work may only lead to a false alarm rate, PfAj rather than to a false alarm probability. 
In such cases the rate , PpA, should be reported (with Pq) and accompanied by a rough estimate 
of the rate of false alarm “opportunities,”O. A rough estimate of PpA — Pfa/^ can then be used 
to calculate SNReff. The non-linearity of the calculation of SNRed is such that even an order of 
magnitude error in Cl will have only a minor offset on the calculated value of SNReff. 
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form of an edge detection algorithm. We recommend that those researching ATR with the edge 
detection technique reexamine the theoretical basis for this work taking advantage of the similarity 
between optimum linear filtering and edge detection. 

Under certain conditions in the case of a well defined target the optimum linear filter outper¬ 
forms the human. The circumstances are that the target is known in detail and in advance (in our 
experiments simply that the target was a disc with well defined edges) and the target does noth¬ 
ing to the background scene except add signature to it (i.e., the target does not hide background 
irregularities). Under these circumstances the human does not seem to be able to collect and to 
assimilate all the edge information in arriving at his decision. Further research should be conducted 
to determine the appropriate background/target situations in which the optimum linear filter may 
be the most appropriate filter. 

We believe that the greatest benefit to ATR research will come from developing an understand¬ 
ing of human non-linear processing in target recognition. This research strongly indicates that a 
non-linear processor has merit when there are details in the target which can only be characterized 
in the statistical sense. By this we mean that you don’t know exactly what the details of a scene 
are, you only have to know something about the statistics of that scene. This target situation more 
closely represents the type of background environment in which a fielded ATR would have to operate. 
We think that further research in the non-linear process will yield a significant payoff. 
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APPENDIX A. CURRENT ATR RESEARCH 

The search for automatic target recognizers (ATR) began three decades ago in the 1960’s. Today 
there are Army, Navy, and Air Force as well as various commercial programs. Each service recognizes 
the military significance of a viable automatic target recognizer. Desired Army applications are: 

1. Target Aquisition for attack helicopters and air defense systems. 

2. Target aquisition for tank and anti-armor systems. 

3. Target aquisition for observed indirect fire. 

4. Minefield detection. 

Desired Navy applications are: 

1. Ocean surveillance and targeting. 

2. Antiship missile recognition. 

3. Land attack weapon guidance, control, and target acquisition. 

4. Air target recognition. 

Desired Air Force applications are: 

1. High value deep target recognition. 

2. Cruise missile advanced guidance. 

3. Autonomous SAR guidance/target recognition. 

4. Image analyst work station data reduction on airborne intelligence platforms. As an emerg¬ 
ing technology ATR research is wide open to different problem solving approaches. ATR 
strategies vary widely. Some of these strategies are listed below: 

1. Multi-sensor aided targeting. Intended principally for airborne use, this approach attempts 
to use the significant advantages of high SNR active radars with advanced algorithms and 
neural networking, generally in conjunction with a FLIR sensor. 

2. Target azimuth, range, elevation and intensity. This approach attempts to use target loca¬ 
tion, and signature intensity information provided by other sources for target recognition. 

3. Edge detection and decision trees. This approach works with optical sensor image data. 
It compares the difference in boundaries between potential targets and their backgrounds. 
The approach considers the edge as the most important piece of target information. 
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Regardless of the approach taken, the ATR under study will produce some characteristic num¬ 
ber of correct responses (true detections, correct identification of no target present) and incorrect 
responses (missed detections, and false alarms). The success of a system can be reported by specify¬ 
ing the number of correct responses and the number of incorrect responses of the system in a given 
target situation. We have noted that the industry suffers from a general failure to quantitatively re¬ 
port both the correct and the incorrect responses of a system together. Perhaps the least ambiguous 
quantitative measure of a system’s performance is the (PD,PFA)-pair- We prefer this technique and 
recommend that whenever possible researchers report their results as (PD,PFA)-pairs. The prob¬ 
lem seems to be most acute for reporting PpA- We acknowledge that the problem with reporting 
PpAComes from the difficulty in determining “the number of possible” detections. For instance a de¬ 
tection device that has a one meter resolution examining a 1,000 m^ area will have fewer detection 
events than a device with ten centimeter resolution. The number of detection for either device will 
be related to the method that device uses to sample the background data. We recommend that when 
researchers find it inappropriate to report PpAdirectly then they should report the false alarm rate 
for the device using the most unambiguous units of measure possible. We futher suggest that these 
reseachers should describe the method used in calculating the P^Arate in the body of the research 
report and describe in their best estimation how that reported false alarm rate may be correlated 
with Pfa- When reporting system results researchers should understand that users are interested in 
how the system under study compares with other systems using the same target situation. 

In considering the measurement of an ATR’s performance it becomes useful to compare the ATR 
in question with a human. We have noted that the overwhelming majority of research work seems to 
use targets that are easy for a man to detect. The targets used for ATR appear easy enough for a man 
to recognize in one rapid pass. Dr. Clarence P. Walters has examined this question. * Dr. Walters 
obtained the algorithms for a number of ongoing ATR projects and implemented these algorithms on 
a computer. He then tested these algoritms against humans in similar background/target situations. 

He concludes that ATR systems and human observers detect targets with the same probability. 
However the ATR systems produce a false alarm rate that is approximately 40 times that of* the 
human observers. He concludes that humans were able to recognize a wider variety of targets because 
they train quickly and well. He states that the ATR was able to recognize more small low contrast 

* Clarence P. Walters, “Human Perception Testing And Automatic Target Recognition: Performance Against A Common 
Imagery Set,” Briefing to The Army Science Board 1994, Paper for distribution to U. S. Government agencies and their 
contractors, 29 June 1993. Refer requests to AMSEHRD-NV-VISPD-LET, 
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targets than the human but that these low contrast detections probably cause the systems’ high false 
alarm rates. Dr Walters recommends that high quality field imagery should be collected to train 
and test both ATRs and humans presumably with the intent of using human performance as the 
goal for ATR. We agree with Dr. Walter’s proposal. We think that until truly optimal performance 
standards predicted by generally accepted ATR theories are identified researchers should compare 
the ATR device under investigation with human performance under similar target and background 
parameters and definitions to provide some practical standard by which to measure ATR system 
performance. 

Different ATR systems are using different target/background situations. These situations vary 
in complexity and difficulty from camouflaged vehicles in a treeline (very difficult) to planes on a 
runway in the open (relatively easy). When reporting ATR results most researchers don’t discuss 
the level of difficulty of the target/background situation. We recommend that the industry establish 
a generally accepted method of determining the relative difficulty of different target situations. We 
think that it would be logical to judge this level of difficulty by asking the question: “how well 
would a man perform using the same target /background definitions and parameters?” We think 
that researchers should report the performance of their systems with a discussion of the relative 
level of difficulty of the target detection problem. 

This appendix reviews some of the current Automatic Target Recognition (ATR) work. The 
sources for most of the material reviewed came from the Proceedings Of the IMAGE UNDER¬ 
STANDING WORKSHOP 13-16 November 1994 and from brifings presented to the ARMY SCI¬ 
ENCE board’s ad hoc study group on ATR in 1994. When possible we focus the review of 
the work being mentioned to target Probability of Detection (Pu) and Probability of False Alarm 
(Pfa)- Ideally we try to report Po, Pfa together as a pair as we have recommended in the thesis body. 
However since most of the reports of ATR research do not address target detection or false alarm 
probabilities directly/quantitatively we report system performance given the performance standards 
reported by the researchers which are most analogous to (PD,PFA)-pairs. Many of the documents 
describing various ATR system work neglect reporting detection and false alarm probabilities, pre¬ 
sumably because they feel correct target classification implies target detection, or because for the 
system under study, the authors plans to rely on some other system for target detection (cueing). 
We believe the difficulty of target detection is imderestimated. It seems to us that reliable target 
detection systems should be developed before before focusing resources on target classification. 
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We have found it useful to group ATR work into two broad approaches. We denote these 
two approaches as statistical and intuitive.The statistical approaches include any form of detection 
whose methodology is dependent upon self adjusting software for recognizing targets with the self 
adjustment being made using essentially a mathematical/analytic approach exploiting “training” 
data (in the statistical approach it is the software that is “trained”). This statistical approach 
includes neural arrays , neural networks, feature extraction algorithms, correlational classifiers. 

The intuitive approaches attempt target recognition/detection using essentially ’smart’, or en¬ 
lightened ideas in the preparation of the target recognition software. The “training” data is only 
used in evaluation of the software’s performance- to make the programmer aware of performance 
problems, so that the software can be revised . In the intuitive approach it is the programmer that is 
“trained.” The intuitive approaches include edge detection, morphology matching, and some forms 
of feature extraction/comparison. 

Statististical detection/recognition depends upon extracting characteristics of a target region 
then comparing these characteristics with values that are expected for specific target types. The 
target and background have different distributions of a statistic which is used to label each region 
as one of two classes. A threshold determines which class a measurement a certain background 
image statistic indicates. The statistical approach may be extended to include many classes and 
many features. Statistical approaches typically execute detection using multidimensional distribu¬ 
tion or decision trees. The multidimensional approaches are more accurate than the decision tree 
approaches, but the decision tree approaches are less computationally intensive. 

We discuss a few representative statistical approaches next. 


The US Army Missile Command is conducting work using a passive multisensor suite. * The sys¬ 
tem developers are considering three supervised pattern recognition approaches. These approaches 
are dynamic feature/statistical analysis, neural arrays, and neural networks. In executing feature 
analysis the researchers state that the approach will limit the number of features to be considered 
by applying the class overlap partitioning scheme. This scheme feeds the image data to a branch- 
and-bound procedure or to a genetic algorithm which then selects features to be considered. The 
set of features selected is applied to an appropriate classifier where a piecewise linear computation is 

* S. Richard F. Sims and M. Bowles, “Feature Analysis Versus Neural Arrays Versus Neural Networks For Multisensor 
Target Recognition,” Brussels Sensor Fusion Conference 1993. 
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carried out. In the report reviewed the researchers claim the system attained 100 percent separation 
between targets and non-targets. 

The neural arrays reported used a vector selection process and the kernels algorithm (k-alg) 
to provide what they call “exemplars” of the object to be recognized. The result reported by the 
researchers was a condensed target-knowledge data base incorporating (according to their claims) 
most of the significant target attributes or features. The resulting set of features was then used 
to create a projector which they said weis such that any input vector if projected onto itself would 
define a target of interest. The performance of the neural array was reported as amplitude of output 
for tanks, helicopters, and clutter. The report stated that the neural array does a “good job” of 
representing training data sets but states that, as the training data sets grows, then so must the 
computational requirements. 

The neural networks reported was the multi layer perceptron using a new self partitioning neural 
network (SPNN) methodology. The image was feature mapped using a frequency transformation 
prior to being fed into the neural net. This network used 40 input nodes, 20 hidden layer nodes 
and one output layer node for each target or target class. Partitioning is done in one pass while 
each training image vector is applied to the network. The researchers state that no training or 
updating of the network weights occurs during the conflict evaluation pass. The errors from each 
node are propagated with the typical back propagation and stored as an error vector. Each set of 
error vectors are then compared to form a conflict matrix. A conflict threshold is used to determine 
a clustering of the training vectors. The researchers state that each cluster is used to train individual 
networks identical to the original one used to generate the error vectors. The researchers report that 
the partitioning approach requires fewer passes to train the net than other neural net approaches. 
However, the designers can not predict the number of networks that can be generated and thus 
cannot predict computational resources needed in different situations. The researchers reported 
that the neural network tested achieved 100 percent recognition in over 200 iterations. 

The direction the Army Missile Command seems to want to take in the future is to combine the 
above algorithmic approaches in the same system and use it in conjunction with a human operator 
in a supervisory role to identify close range high signature targets. 


The Davis Sarnoff Research Center is investigating combining neural networks with pyramid 
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representations for target recognition.* The researchers claim that the relatively simple image 
features produced using their “pyramid” image reduction algorithm are more effective neural network 
inputs than more complex object-tuned features. The system conducts a coarse-to-fine search, and 
is capable of context learning and data fusion. The most succesful experimental results seem to 
come from a system that employs a hierarchical network capable of employing what are termed 
“road maps.” As an example, generation of a road map from an image may be thought of as the 
assignment of pixel weights to an image by measuring the distance of a region of interest from a 
fixed relatively long linear feature. The Sarnoff study compared the pyramid technique with a similar 
technique using eigenfeatures. They reported that the pyramid technique appears to be more robust. 
The initial results of this research in detecting buildings in a rural setting (a relatively easy target) 
were reported as a ROC curve with true positives (as a percent) reported against false positives (as 
a percent). The (Pd,Rfa)- pairs thus reported ranged from (0.85,0.03) to (0.94,0.12). 

Neural Networks Laboratory and the Illinois Institute of Technology are also researching a 
neural network approach to target detection.* The neural system consists of a shape description 
network, a geometric normalization network, and a recognition stage using what they call fuzzy 
pyramidal neural networks. This research uses two innovative approaches. First is a novel pyramidal 
architecture called “the vectorial gradual lattice pyramid” which is a vectorial space representation of 
shape. Second is a method to determine feature tokens called “cancellation energy.” The cancellation 
energy approach uses directional information in the vectorial space representation of shape. The 
targets used in the research appear to have been aircraft in the open. The results of the research 
reported were that the recognition rate was between thirty five and one hundred percent depending on 
the target orientation and scaling factor used. The research also reports that “invariant recognition 
with similarity transforms as well as moderate afiine transforms are possible .” It is noteable that 
the research does not mention measurements of false alarm rate. 


The Hughes Aircraft Company is researching the what they call Self Adaptive Hierarchical 
Target Identification and Recognition System (SAHTIRN).'^ SAHTIRN applies a fast prescreening 

* Clay Spence et al., “Neural Network/Pyramid Architectures That Learn Target Context,” Proceedings of Image Under¬ 
standing Workshop, Vol. II, pp. 853, November 1994. 

* Jezekiel Ben-Arie, K. Raghunath Rao and Zhiquian Wang “A Neural Network Approach for Shape Description and 
Invariant Recognition,” Proceedings of Image Understanding Workshop, Vol. II, pp. 863, November 1994. 

* Cindy E. Daniell et al., “Artificial Neural Networks for Automatic Target Recognition,” Proceedings of Image Understand- 
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process over an entire field of regard to select potential targets for further processing. SAHTIRN 
then classifies potential targets as targets or not targets (f.e.the system does target detection). For 
those identified as targets SAHTIRN specifies the type of target it is (i.e.the system does target 
classification). The researchers claim that SAHTIRN accomplishes this using three stages of neural 
networks. These stages are; 

1. Segmentation (forms coherent boundaries out of many individual local edge elements):- 

2. Feature extraction and pattern coding using what is refered to as a “neocognitron”(A 
hierarchical feed-forward system is organized into several homogeneous layers. Transfor¬ 
mation between layers is accomplished by convolutional masks, which serve as connections 
between neurons.) 

3. Classification of the specific target through the use of a back propagation learning rule:- 
(This back propagation procedure is implemented in a parallel computer that, in general, 
having been shown the appropriate input/output exemplars specifying some mapping func¬ 
tion, programs itself to compute that function.) 

The study reported successful ATR performance when looking for targets on a terrain board. 

The test results seemed to focus on correct target classification not detection. The reported results 
include probabilities of correct and missed classifications and probabilities of rejection. Results for 
the detection stage are not reported in a form that allows determination of the values for (PD^RFA)- 
pairs. 

HNC Software INC is researching many recognition approaches at least two of which are sta¬ 
tistical and merit mention here. The two approaches execute target recognition through “context 
vectors” * or the k nearest neighbors.f The context vector approach is described as using affine 
wavelet transformations to define a set of image primitives. These primitives are treated as com¬ 
prising a vocabulary of image features. The system is designed to provide content address ability 
of images based on similarity of text or images. The system highlights portions of retrieved images 
that most closely correspond to user queries then assigns index terms to unlabelled images based on 
similarity of content to a trained set of images. No (FdjRfa) performance results were provided for 
ing Workshop, Vol. II, pp. 853, November 1994. 

* Robert Hecht-Nielson et al., “Fast k-NN Search for Robust ATR Object Matching,” Proceedings of Image Understand- 
ingWorkshop, Vol.II,pp. 889 

I William R. Caid, “A Context Vector Approach to Image Indexing and Retrieval,” Proceedings of Image Understanding 
Workshop, Vol. II, pp. 885, November 1994. 
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the context vector approach. The application is perhaps unique in that it is stated it has commercial 
applications. The system is currently being studied for use in text based retrieval systems such as 
an automated library retrieval system. 

The k nearest neighbor approach is designed to recognize partially obstructed targets. In 
this technique targets are first defined by spatial frequency based feature vectors. The obstructed 
target feature vectors are then matched against a large feature vector reference data base to find 
reference feature vectors with at least fifty percent matched features. The matching algorithm uses 
a generalization of Euclidian distance called Rousseeuw distance. The system finds the k nearest 
Rousseeuw distance matches using a voting operation. This voting operation decides the class 
membership of the target. The system requires very large target databases and does not address 
target detection. No {Pd,Pfa) results were reported for the k nearest neighbor approach. 


The US Army research Laboratory is investigating relational template matching (RTM) for 
target recognition/detection.* RTM uses a model based multisensor ATR algorithm to recognize 
military targets under a variety of different environmental conditions with ranges to targets of 1- 
6 kilometers. The researchers claim the ATR system applies an optimization methodology and 
an ATR algorithm. The optimization process (done once for a given set of targets) partitions 
and categorizes target signatures. This optimization process has a high degree of computational 
complexity. The system uses the relational templates to discriminate between target categories. A 
recognition algoritm compares aspects of a target with known aspects of different classes of targets. 
These target aspects are found by application of the edge detection technique. The edge detection 
technique uses many sets of probes (each probe being two points) we believe taking advantage of 
the theory that the intensity change across a target boundary is on average greater than in the local 
background. The many values found by the target probes determine the target aspects which are 
compared with the known aspects of different targets. The work reviewed did not reveal the results 
of this research in terms of (PD,RFA)-pairs. 

Discussed next are some intuitive approaches to target recognition/detection. 


Lincoln Laboratory and MIT are researching what they call The Experimental Target Recog- 
* Ms Teresa Kipp, “ATR Relational Template Matching,” Briefing to The Army Science Board 1994. 
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nition System (XTR5).^Researchers claim XTRS detects and recognizes armored tactical vehicles 
in registered range and intensity images provided by ground based and airborne laser radars. They 
say that XTRS can recognize very noisy images at arbitrary distances and orientations. The key 
innovation is a generic matching engine that compares image events (i.e. silhouettes) in the form of 
constituent primitives to some appearance model (AM) hierarchy. XTRS consists of four subsystems: 

1. Event characterization describes the relevant features (image events ) of the input imagery. 
Events are transformed into “range silhouettes” using “edge detection” and “region seg¬ 
mentation.” The report states that the event is decomposed into an “event primitive” 
which is output to the model library. In edge detection the image event is first cleaned 
(all isolated dark pixels are removed) then convolved with a difference-of-Gaussian kernel. 

The so-convolved output is examined for “zero crossings” which correspond to the edges 
in the image. These zero crossings have characteristic length, average strength. These 
characteristic aspects form the event primitive. In range segmentation detection the image 
event is also cleaned then examined for interesting features. Each interesting feature forms 
an “interest image.” The interest image with the most interesting aspects is selected and 
contour outlined to form an event primitive. 

2. The model library contains the targets to be recognized stored as Appearance Models ( 
AM’s). AMs are descriptions of expected target appearance over a useful range of aspects. 
Two different model libraries are used depending on whether the event primitive was gen¬ 
erated from edge detection or region segmentation. The event primitive is then matched 
to the model from the model library. 

3. Matching is the process of comparing the extracted event and it’s constituent primitives to 
the models in the library. The same matching engine is used for edge detection primitives 
and for region segmentation primitives. 

4. Control orchestrates the operation of the other three components. 

The XTRS system research reported recognition results in terms of correct classification. The 
report did not specifically address target detection . Depending on target type the system reported 
a 65- 98 percent classification success rate. 

The College of Engineering of the University of California, Riverside is researching a model based 

t Jacques G. Verly et ai., “Model Based System for Automatic Target Recognition from Forward-Looking Laser Radar,” 
Optical Engineering, Vol31 No 12, pp. 2540, Dec 1992. 
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target recognition system that uses a hierarchical Gabor wavelet representation.* The approach 
combines the global and local Gabor-based measures for target indexing into a model data base. 
The ATR system uses the Gabor wavelet to decompose target models and image data and a Gabor 
grid (which can be thought of as a topology-preserving map) to efficiently encode both signal energy 
and structural information of a target in a sparse multi-resolution representation. The system uses 
a flexible matching mechanism based on the Gabor decomposition and the Gabor Grid. Gabor 
frequency is used to estimate the scale variation of a target from a model. Gabor magnitude is used 
for probe matching based on local structural energy patterns. Gabor phase is used to evaluate the 
matching result in terms of average local image displacement between the model and the data. The 
researchers report that the system does not rely on shape features or contours for target detection 
and reports being tolerant of distortions of viewing scale, aspect, and environmentally induced 
deviations. The reported results are that a 98 percent recognition rate is achieved in 207 recognition 
experiments. The research further reports tolerating signature variations of 20 degrees in depression 
angles of 22.5 degrees with up to fifty percent occlusion. No (Pd,Pfa) results are obtainable from 
the report. 


The Beckman Institute for Advanced Science and Technology is researching a two dimensional 
edge detection scheme for general visual processing.* The researchers report that the scheme con¬ 
structs a 2D edge detection functional to detect edges under the guidance of the Laplacian of 
Gaussian zero crossing contours. They claim the detection functional is optimal in terms of SNR 
and edge localization accuracy for detecting edges in 2D images. The researchers claim the detection 
technique provides: 

1. An edge regularization procedure that enhances the continuity and smoothness of the 
detected edges except at corners. 

2. An adaptive edge thresholding procedure that is based on a robust global noise estimation 
approach and two other physiologically originated criteria. 

3. A scale space procedure that combines edge detection results from different scale channels 
reliably. The researchers do not report the performance of their system in terms of detected 

* Xing Wu and Bir Bhanu, “Target Recognition using Multi-scale Gabor Filters,” Proceedings of Image Understanding 
Workshop, Vol.I, pp.505, November 1994. 

* Richard J. Qian and Thomas S. Huang,“Optimal Edge Detection in Two-Dimensional Images,” Proceedings of Image 
Understanding Workshop, Vol.II, pp.l581, November 1994. 
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targets or edges. They offer three images of what looks like a sketch of a human subject 
with distinct edge characteristics as evidence that the system fine tunes edge detection 
results to make them similar to what is percieved by human visual systems. 


In reviewing the literature related to ATR we tried to compare the results of the different 
techniques in effort to gain a quantitative assessment of the relative success of one system to other 
systems. We have noted that this is impossible to do. Much of the problem lies in the relative 
difference in the types of targets each system is designed to look for and the background clutter 
the system designers tend to put those targets in. We accept these differences and understand that 
target recognition performance is situationally dependent. We have also noted a general failure on 
the part of ATR designers to report the performance of their system in terms of (PD,RFA)-pairs. 
In particular there is almost a reluctance to report the performance of a system in terms of false 
alrm rate, and when the false alarm rates are reported they are often sufficiently ambiguous to be 
misleading. We think this is a self defeating approach that fails to clearly present the significant gains 
made by the community in the past decade, or to clearly represent the operational capability of the 
present systems which may have tactical application in a limitted scenario today. We recommend 
that the industry study the question of how best to standardize the reporting of ATR performance, 
so as to develop a meaningful way to compare the techniques and systems being studied without 
destroying the creativity needed in the problem solving process. 
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APPENDIX B. EXPERIMENTAL DATA 


This appendix contains data for Experiments 1,2,3 not included in the main body of the thesis. 
This data is displayed on probability-probability (PRBPRB) graphs which are discussed in the thesis 
main body (Chapter I Introduction). 
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1. EXPERIMENTAL DATA. EXPERIMENT 1 

The following pages contain Experimental data for Experiment 1. The data is shown as 
PRBPRB plots of an operator (PD,RFA)-paii' and a matched filter (which in the type of background 
used in these experiments is the optimum linear filter) ROC. 
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FIGURE 26. Experiment 1 Snrnom=3, Diameter=21 
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2. EXPERIMENTAL DATA. EXPERIMENT 2: OPTIMUM LINEAR FILTER 

The following pages contain experimental data for Experiment 2. The data is shown as PRBPRB 
plot of an operator (PD,PFA)-pair and an optimum linear filter ROC. 
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FIGURE 27. Experiment 2 Signal=4.0, Diameter=ll. 
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FIGURE 29. Experiment 2 Signal=4.0, Diameter=3. 
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FIGURE 30. Experiment 2 Signal=4.0, Diameter=5. 
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FIGURE 31. Experiment 2, Signal=4.5, Diameter=9. 
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2. EXPERIMENTAL DATA. EXPERIMENT 2: MATCHED FILTER 

The following pages contain experimental data for Experiment 2. The data is shown as PRBPRB 
plots of an operator (PDiT’FA)-pair and a matched filter ROC. 
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FIGURE 32. 


Experiment 2 Matched Filter Signal=4.0, Diameter=21 







FIGURE 33. 


Experiment 2 Matched Filter Signal=4.5, Diameter=l. 
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FIGURE 34. Experiment 2 Matched Filter Signal=4.5, Diameter=ll 
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Experiment 2 Signal=4.0, Diameter=5 






FIGURE 38. Experiment 2 



Filter Signal=4.5, Diameter=9. 




3. EXPERIMENTAL DATA. EXPERIMENT 3 

All experimental data for the optimum linear filter used in Experiment 3 are included in the 
main body of the thesis. The following pages show PRBPRB plots of an operator (PD,PFA)-pair 
and a matched filter ROC. 
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FIGURE 39. Experiment 3 Matched Filter Signal=0.0, Diametr=21 
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FIGURE 40. Experiment 3 Matched Filter Signal=1.5, Diameter=21. 


96 




APPENDIX C. COMPUTER PROGRAMS 


This appendix contains the computer programs used in the experiments conducted for the 
thesis and a short discussion of the program flow for each experiment. Each eperiment was under 
the overall control of the computer. The computer acted as the control, center. In this command 
role the computer selected the background/target definitions and parameters. The computer made 
the decision of whether a target was to be present in a given display. Only the computer knew 
this information. Neither the operator nor the machine/filter were told whether or not a target 
was present. Each of the experiments collects both operator and machine performance data in the 
form of (PD,PFA)-pairs- The programs used for this collection process specific to each experiment 
are discussed in subsections of this appendix. The last subsection contains the programs that are 
common to all experiments. The appendix contains four subsections. These subsections are: 

1 . Appendix C-RWG Contains the programs that support Experiment 1. 

2 . Appendix C-SPOT Contains the programs that support Experiment 2. 

3 . Appendix C-SPOTC Contains the programs that supportExperiment 3. 

4 . Appendix C-Common Contains the programs that are common to all the experiments. 

Each experiment generated images for a human to observe on the computer screen. The human 

made a target present or not present decision through the use of the keyboard. The computer told 
the operator whether each decision he made was right or wrong and recorded these decisions as 
detections or false alarms. At the end of a sequence of trials the computer calculated probability 
of detection and probability of false alarm for the operator. For the operator the experimental 
data thus recorded was a single (PdiPfa)"?^!!"- The computer used the same target definitions and 
parameters to generate probabilities of detection and false alarm for a machine/filter equipped with 
either an optimum linear filter or for a matched filter. For the machine/filter the computer used 
10,000 trials to generate (PD,EFA)-pairs at 100 different thresholds using 100 different threshold 
settings. The computer collected 100 (PD,PFA)'Pairs for the machine/filter in each experiment. 

The Programming language used in all of the programs was MATLAB. 
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APPENDIX C RWG 


This appendix contains a printout of the programs written which support experiment 1. This 
experiment uses random white Gaussian (RWG) background images. The control program is OP- 
MACH. This program calls two other programs called OPWHITE and MACHPERF. The OP- 
WHITE program collects the operator (PoiPFAl-pair and the MACHPERF program collects the 
machine (PD,PFA)-pairs. 

The OPWHITE program interfaces with the operator through the keyboard and the computer 
monitor. The computer monitor displays eighteen target/background images, and a decision box 
for the operator to input his choice of target present or not present. OPWHITE calls the programs 
MAKEPILL, SNRESTER and EXOPR3. The EXOPR3 program serves as the interface between 
the operator and the computer monitor for the experimental data collection phase of the exper¬ 
iment. This program collects the effective (PD,PFA)-pair. EXOPR3 calls the programs CHECK, 
WRITEFILE, CAMO, SHOW, SCALE(1,2,3), CIRCDAT. The program CIRCDAT generates the 
target/background image. The MACHPERF program contains the algorithm to implement the ma¬ 
chine/filter. The MACHPERF program in effect offers the same target/background definitions and 
parameters to the machine/filter as those shown to the operator. The MACHPERF program calls 
the programs MAKEPILL and NOISEGEN. The program NOISEGEN calculates the background 
pixel values needed such that a target with a specified signature will yield the nominal signal-to- 
nois e-ratio. 


EXPERIMENT 1 


OPMACH 

% function called opmach designed to run opvliite and macl^erf. 

’/, The program obtains operator and machine probability of detection, 
*/. probability of false alarm data (PD,PFA)-pairs and graphs them for 
comparison. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 


•/. 

y. INPUTS 
■/. sig (1,1) 

y, snmomCl,!) 
y. D (1,1) 

y. 

y. n ( 1 , 1 ) 

y, Nsub (l,num) 

y. 

y. 

y. OUTPUTS 

y. PDo ( 1 , 1 ) 

y. PFAQ (1,1) 

y. 

y. PDMQS (100,1) 

y. 

y. PFAM0S( 100,1) 

y. 
y. 
y. 
y. 


Input pixel value of target 

Nominal signal to noise for experiment 

Diameter of circular disc to be used in defining 

the filter; D must be odd. 

number of displays 

nundMr of pixels on the x axis. 


= Probability the operator had a true detection 
= Probability the operator thought there was a 
target but there was none 
= Probability of true detection-report by optimum 
filter at operator signal 

= Probability of false detection-report by optimum 
filter at operator signal 


[PDO, PFAO, PFAMOS, PDHOS] =opmach(n, Nsub, D, sig, snmom) 


function [PDO,PFAO,PFAMOS,PDMOS]=opmach(n,Nsub,D,sig,snmom) ; 

G=randn(2S6,256); 

load start 

[PDO, PFAO, snrbar, sigsnr, snrexp, cl, c2,c3,c4] =opwhite(n, sig, snmom,D, Nsub) ; 
[PDMOS,PFAMOS] =machperf (sig,snmom,D,G,PDO,PFAO,Nsub) ; 
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35 load start; 

36 H=prbprb(PFA,PD); 

37 prprlaer(PDO,PFAO,H,’*’) : 

38 prprlaer(PDM0S,PFAM0S,H) 

39 load fniun; 

40 fig=spriiitf (’exp#‘/,1.0f ’ .fnum) 


OPWHITE 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 




'/. Function called opwhite designed to check an operator’s nominal 
y, signal-to-noise ratio (snmom) during a target recognition sequence, 
y. The fimction calculates an operators effective signal-to-noise-ratio 
y, (snreff) from the error function and the experimental (PD,PFA)-pair. 
y, The program then compares snreff with snmom to ensure snreff 
y, is vithin 2 standard deviations of snmom. The program allows the 
y, operator as many training trials as he requests and allows the 
y, operator to adjust the signal strength. 

y. 


y. 


y. IKPUTS 
y. n (1.1) 
y. sig (1,1) 
y. D (1,1) 
y, Hsub (1,1) 

y, snmomd,!) 

y. 


=Total number of operator trials used in the experiment 
=Target signal level 
=Target radius 

=Size of background matrix to display 
^Hominal signal to noise ratio 


y. 


y. OUTPUTS 
y, snrexpd,!) 

V 

/« 

y, sigsnrd,!) 

y, snrbard,!) 

y. PDO 

(1,1) 

y. PFAO 

(1,1) 

y. cl 

V 

(2,1) 

i c2 

V 

(2,1) 

U 

y. c 3 

(2,1) 

y. c4 

(2,1) 


y. 


^Signal to noise ratio that the operator performs with 
during the experiment. 

“Standard deviation of the snmom 
“average snr expected 
“operator probability of detection 
“operator probability of falsa alarm 
“ number of times target was present and 
detected 

^ number of times target was present and not 
detected 

= number of times no target and no detection 
= number of times no target and false detection 


y. 

y. [PDO,PFAO,snrbar,sigsnr,snrexp,cl,c2,c3,c4!!=opwhite(n,sig,snmom, ... 

D,H8ub); 


function [PD0,PFA0,snrbar,sig3nr,snraxp,cl,c2,c3,c4]= ... 

opwhite(n,sig,snmom,D.Nsub); 
noise“noigen(snmom,sig,D,Hsub); 

[sigsnr,snrbar]“snrester(n,snmom); 
pill“makepill(Nsub,D); 

[cl,c2,c3,c4,flag,PDO,PFAO,surexp]=exopr3(n,Hsub,D,sig, ... 

noise,snrbar,sigsnr,pill); 


EXOPR3 


1 

2 

3 

4 

5 

6 




% function called ezopr3 used to collect operator (PD,PFA)-pairs, 
y. The program displays three series of tzurget images. The first series 
y, displays a circular disc target in a background pattern. The second 
% series displays a circular disc target in a background pattern where 
y, the background and target are between the mitiiiniiBi pixel veilue and the 
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7 ■/. mean value of the pixels. The third series displays a circular disk 

8 ■/. target in a background pattern where the disc and the background 

9 '/, pattern are between the mean background pixel value and the maximum 

10 ■/, background pixel value. The monitor display provides the operator 

11 ’/. with the equivalent of a color/contrast control knob. 

12 •/. 


13 */ 


INPUTS 



14 •/ 

> n 

(1,0 

= 

number of displays 

15 •/ 

Nsub 

(1,1) 

= 

size of the background scene for display. 

16 •/ 

i D 

(1.1) 

= 

circle Diameter 

17 '/ 

i sig 

(1,1) 

= 

Target signal 

18 •/ 

noise 

(1.1) 

- 

Target noise 

19 •/ 

', snmom 

(1,1) 

= 

nominal signal to noise voltage ratio 

20 •/ 

sigsnr 

(1,1) 

= 

standard deviation of the signal to noise 

21 •/ 

t 



ratio 

22 •/ 

( ss 

(Nsub,Nsub) 

= 

Box containing signal disc at center 

23 •/ 





24 

> 




25 •/ 

1 

OUTPUTS 



26 •/ 

cl 

(2,1) 

= 

number of times target was present and 

27 •/ 

1 



detected 

28 •/ 

' c2 

(2,1) 

= 

niimber of times target was present and not 

29 • 

/ 



detected 

30 •/ 

c3 

(2,1) 

= 

number of times no target eind no detection 

31 • 

i c4 

(2.1) 

= 

number of times no target and false detection 

32 •/ 

flag 

(1,1) 

= 

emergency exit indicator. 

33 ‘ 




(1/0)=(e-exit/norm-end) 

34 : 

C PDQ 

(1,1) 


Probability the target was present and the 

35 •/ 




operator identified it 

36 / 

( PFAQ 

(1,1) 


Probability the target was not present but 

37 •/ 

( 



the operator thought it was present 

38 / 

( snrexp 

(1,1) 

* 

Signal to noise voltage ratio of the operator 

39 • 




during the experiment 


40 •/. 

41 •/. 

42 ■/, Ccl,c2,c3,c4,flag,PD0,PFA0,3nrexp]=exopr3(n,Hsub,D,sig, ... 

43 noise,snmom,sigsnr,ss) 

44 

45 function [cl,c2,c3,c4,flag,PD0,PFA0,3nrexp]=exopr3(n,Nsub,D,sig, ... 

46 noise ,snmom,sigsnr,ss) ; 

47 R=(D-l)/2; 

48 cl=0;c2=0;c3=0:c4=0; 

49 cla,clg,axis(’off: 

50 flag=0; 

51 count=l; 

52 for k=l:n 

53 if flag = 1 end 

54 T=(rand(l.l)>0.5): 

55 cla,clg; 

56 ki”rand<l,l); 

57 while ki=l; 

58 ki^andd,!); 

59 end 

60 ky=rand(l,l); 

61 while ky=l; 

62 kjnrandCl.l); 

63 end 

64 [iiiB,SD,zpl]=circdat(Hstd>,D,noise,sig) ; 

65 zsl=zpl+(ss*sig*T); 

66 subll=scalingl(zsl,mn,SD,.01,R); 

67 showr(subll,.025,.05,.14,.3.(D-l)/2); 

68 subll=scalingl(zsl,iiiii,SD,l,R); 

69 showr(subll,.19,.05,.14,.3,(D-1)/2); 

70 subll=scalingl(zsl,mD,SD,1.5,R); 

71 3howr(subll,.355,.05,.14,.3,(D-l)/2): 

72 subll=scallngl(zsl,im,SD,2,R); 

73 showr(subll,.52,.05,.14,.3,(D-l)/2); 

74 subll=scalingl(zsl,im,SD,2.5,R); 
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75 showr(subll,.685,.05,.14,.3,(D-l)/2); 

76 subll=scalingl(zsl ,inm,SD ,3,R) ; 

77 showr(subll,.85,.05,.14,.3,(D-1)/2); 

78 

79 [imnl,SDl,zp2]=circdat(Nsub,D,noise,sig) ; 

80 zs2=zp2+(ss»sig*T); 

81 [3ubl2,scale]=scaling2(zs2,iiiml,SDl,1.4,a); 

82 showr(subl2,.025,.35,.14,.3,(D-l)/2); 

83 [subl2,scale]=scaling2(zs2,mml,SDl,(3cale+l) ,R) ; 

84 showr(subl2,.19,.35,.14,.3,(D-l)/2); 

85 [subl2,scale]=scaling2(zs2,mml,SD1,(scale+2),R); 

86 showr(subl2,.355,.35,.14,.3,(D-l)/2); 

87 [3ubl2,scale]=3caling2(zs2,mnil ,SD1, (scale+3) ,R); 

88 3howrCsubL2,.52,.35,.14,.3,(D-l)/2); 

89 [subl2,3cal6]=3caling2(z32,mml,SD1,(3cale+4),R); 

90 showr(3ubl2,.685,.35,.14,.3,(D-1)/2); 

91 [3ubl2,scale]=acaling2(zs2,mml,SDl,(3calO't-5) ,R); 

92 showr(subl2,.85,.35,.14,.3,(D-l)/2); 

93 

94 [imn2,SD2,zp3]=circdat(Nsub,D,noi3e,3ig); 

95 z33=zp3+(ss*aig»T); 

96 [3Ubl3,scale]=3caliiig3(zs3,inni2,SD2,l,R); 

97 3howr(3ubl3,.025,.65,.14,.3,(D-l)/2); 

98 [ 3 ubl 3 ,scale]=3caling3(z33,mm2,SD2,(3cale+.5),R); 

99 showr(3ubl3,.19,.65,.14,.3,(D-l)/2); 

100 [3Ubl3,scale]=3caling3(zs3,mm2,SD2,(3cale+.75),R); 

101 3howr(subl3,.355,.65,.14,.3,(D-l)/2); 

102 [3ubl3,3cale]=scaling3(z33,mm2,SD2,(3cale+l),R) ; 

103 showr(subl3,.52,.65,.14,.3,(D-l)/2): 

104 [sublS,scale]=scaling3(z33,mm2,SD2,(scale+l.5),R); 

106 showr (subl3,.685,.65,.14,.3,(D-i)/2); 

106 [8ubl3,acala]“Scaling3(2a3,mm2,SD2,(acale+2),R) ; 

107 showr(subl3,.85,.65,.14,.3,(D-i)/2); 

108 dispCtarget number is’); 

109 disp (count): 

110 tgt “ inputCis there a target? C(y/n); '(y/n) ... 

111 exits test loop] »’,’s’); 

112 if (tgt“‘y’l tgt==’n’) 

113 count=count+l: 

114 if T; 

115 if tgt==’y’ 

116 disp(’CORRECT’); 

117 cl=cl+l; 

118 else 

119 disp(’WRONG’): 

120 c2=c2+l: 

121 end 

122 else 

123 if tgt==-’y’ 

124 disp(’WRONG’): 

125 c4^4+l; 

126 else 

127 dispC’CORRECT’); 

128 c3”c3+l; 

129 end 

130 end 

131 if connt“floor(n/5) I count'“floor(2*n/5) I count” floor(3*n/5) ... 

132 I count”“floor(4*n/6) |count==n: 

133 [PD0,PFA0,snrerp,flag]“check(cl,c2,c3,c4,snmom,sigsnr); 

134 save opwdata cl c2 c3 c4 PDO PFAO snrezp sigsnr sig snmom D Nsub; 

135 writefiKcount,cl,c2,c3,c4,3nrexp,PDO,PFAO,sigsnr,sig,snmom,D,Nsub) ; 

136 else 

137 PD0=cl/(cl+c2): 

138 PFA0=c4/(c3+c4): 

139 if PD0<1 b PD0>0 b PFA0<1 ftPFA0>0 

140 t2sig=erfinv(l-2*PFA0); 

141 snrexp=sqrt(2)*(t2sig-erfimr(l-2*PD0)); 

142 sprintf (’PD0:y,5.4f PFA0;7,5.4f snreip:y.5.4f’,PDO,PFAO,snrexp) 
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end 


143 

144 end 

145 if flag==l break; end 

146 else 

147 flag=l: 

148 break; 

149 end 

150 end 

151 PDQ=(cl)/(cl+c2) ; 

152 PFA0=(c4)/(c3+c4) ; 

153 t2sig=erfinv(l-2*PFA0); 

154 snrerp=sqrt(2)*(t2sig-erfinv(l-2*PD0)); 


CIRC DAT 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 
27 
23 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 


% function called circdat used to generate a pixel image of a circle 
'/, in a square background. The background pixel values have a gaussiam 
’/, random distribution 


INPUTS 

( 1 . 1 ) 


signal 


= number of pixels on the side of the 
square 

= circle diameter 
= rms noise level 

= fixed level (above or belou one-half) 
for circle signal 


*/. mm (1,1) = mean pixel value of target circle 

*/, SD (1,1) = pixel standard deviation in sub uith target 

*/, pic (Hsub.Hsub) = Random background matrix 

•/. 

•/, 

*/, [am, SD, pic] =circdat(Hsub,D,noise, signed.) 


function Cmm,SD,pic]=circdat(Hsub,D,noise,signal); 
R=(D-l)/2; 

pic=noise*randn(H3ub,N3ub)+0.5: 
x=((l:Nsub)-Nsiib/2).'2; x=x’*onas(size(x)) ; y=x’; 
xy=x+x’; 

ii=find(x 7 >R‘2) ; 
jj=find(xy<=R'2); 
jjj=find(xy=-R‘2) ; 

Sig=signal*onaa(Hsub,Hsub); 
Sig(ii)=zeros(siza(Sig(ii))); 
pic=pic+Sig; 

Tu=0.5+3ign2j.+2.0*noi3a; 

71=0.5-2.0*noisa; 

Cout=sum(sum(ones(size(ii)))); 

C=Hsub‘2-Cout; 
kk=find(pic>Tu); 
picu=zeros(aiza(pic)); 
picu(kk)=pic(kk)-Tu; 
pic(kk)=Tu*ones(size(pic(kk))); 
ll=f ind(pic<Tl); 
picl=zeros(3ize(pic)); 
picl(ll)=pic(ll)-Tl; 
pic(ll)=Tl*ones(size(pic(ll))); 
picul=picu+picl; 

adjout=s\m(su]n(picul(ii) ) )/Cout; 

pic(ii)=pic(ii)+adjout; 

adjin=sum(sum(picul(j j)))/C; 

pic(jj)=pic(jj)+adjin: 

pied, 1) =Tu+0.25*noiae: 
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53 picCl,2)=Tl-0.25+noise; 

54 nim=mean(pic(jj)); 

55 SD=std(pic(jj(:))); 


MACHPERF 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 




*/, Function called machperf designed to analyze performance in terms 
*/, of PD/PFA of a machine in looking for a uniform circular disc target. 
y. The target is present in a background scene that is randomly chosen, 
y. The machine uses a set of filter weights (from a matched filter) 


y, and a threshold to detect targets. 

y. 

y. 


y, INPUTS 

y, sig (1,1) 

y, snmomd.l) 

y. D (1.1) 

y. 

y. 0 (256,256) 

y. PDQ (1,1) 

y. PFAQ (1,1) 
y, Nsub (1, N) 

y. 

y. OUTPUTS 
y. PDMQS ( 100 , 1 ) 

y. 

y, PFAMOS ( 100 , 1 ) 

y. 

y. 


= Input pixel value of target 
= nominal signal to noise ratio 

= Diameter of circular disc to be used in defining 
the filter; D must be odd. 

= Random background 
= Operator probability of detection 
= Operator probability of false alarm 
= Size of background scene to display 


= Probability of true detection-report by optimum 
filter at operator signal 

= Probability of false detection-report by optimum 
filter at operator signal 


y. 


y. 

y, CPDM0S,PFAM0S]=macl^arf (sig,snmom,D,G,PD0,PFA0,Nsub) ; 


function CPDM0S,PFAM0S]=machperf (sig,snmom,D,G,PD,PFA,Hsub) ; 
siguFsig; 

noise=noigen(snmom,sig,D,Nsub) ; 
pill=makepill(Nsub,D); 

R=(D-l)/2: 

RK=(Hsub-l)/2; 
x=(-RK:RH).‘2: 
r=ones(size(i’)): 

R2=i+x’: 

ii=find(R2<=R'2); 

L=length(ii); 
pd=256-Hsub; 
qd=256-Hsub; 

Suml= □ : 

N=10000; 

x=n: 

Y=a: 

A”sum(pill(ii)); 
for b=>l:H 

I” (RH+l)+pd*rand(l,l): 
y- (RH+1)+qd*rand(1,1); 

Z- G(i-RH:i+RH,y-RN:y+RN): 

SumlxCSuml; sum(sum(Z.*pill))l; 
end 

Sums''[Suml*noise Suml*noise-t-sigm*L]; 

T=linspace(min(min(Sums)),maz(max(Sums)),102); 

T(102) = a ; 

T(1)=D; 

PDM0S= □ ; 

PFAM0S=n ; 
for b=l:100 

e“(T(b) < Sums); 
e=sum(e); 
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62 PDMOS=CPDMOS e(2)/N]; 

63 PFAMOS=CPFAMOS e(l)/N]; 

64 end 



APPENDIX C SPOT 


This appendix contains a printout of the programs written which support experiment 2. This 
experiment uses SPOT background images. The control program is OPMACH. This program calls 
programs called OPNWHITE and MACHPERF. The OPNWHITE program collects the operator 
(PD,-PFA)-pair and the MACHPERF program collects the machine (PD,PFA)-pairs. 

The OPNWHITE program provides the operator with a training phase then when the operator 
feels comfortable with target recognition the program begins the experimental phase. The OPN¬ 
WHITE program interfaces with the operator through the keyboard and the computer monitor. The 
computer monitor displays eighteen target/background images, and a decision box for the operator 
to input his choice of target present or not present. OPNWHITE calls the programs MAKEPILL, 
PDSNREST and EXOPR3. PDSNREST estimates the effective (PD,PFA)-pair of an xperiment. 
PDSNREST allows the operator to have as many training trials as he requests. The program also 
allows the operator to adjust the target signature strength so that the effective (PDiPFA)-pair is 
close to the nominal (PD,PFA)-pair. The PDSNREST calls the program EXOPR3 which serves as 
the interface between the monitor and the operator and collects/calculates the operator effective 
(Po,Pp,i^)-pair. The EXOPR4 program serves as the interface between the operator and the com¬ 
puter monitor for the experimental data collection phase of the experiment. This program collects 
the effective (PD,PFA)-pair collected as data. EXOPR4 calls the programs CHECK, WRITEFILE, 
CAMO, SHOW, SCALE(1,2,3), MTAR. MTAR adds a target of uniform signature to the back¬ 
ground pixels. The MACHPERF program contains the algorithm to implement the machine/filter. 
The MACHPERF program in effect offers the same target/background definitions and parameters 
to the machine/filter as those shown to the operator. The MACHPERF program calls the programs 
PSDGEN, MAKEPILL, CAM. MAKEPILL and CAM serve the same purpose as in the operator 
collection phase. The program PSDGEN calculates the background matrix spatial frequency power 
spectral density (PSD) which is then used to implement the optimum linear filter. 


EXPERIMENT 2 


OPMACH 
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'/, function called opmach designed to run opwhite and nacbperf. 

*/, The program obtains operator and machine probability of detection, 
'/, probability of false alarm and graphs them for conqjarison. 

•/. 


•/. 

7. INPUTS 
7, sig (1,1) 

7. D (1,1) 

7. 

7. n (1,1) 

7. Hsub (l,num) 

7. 

7. 


Input pixel value of target 

Diameter of circular disc to be used in defining the 

filter; D must be odd. 

number of displays 

number of pixels on the x axis. 


7. OUTPUTS 

7, PDO (1,1) = Probability the operator had a true detection 

7. PFAO (1,1) = Probability the operator thought there was a 

7, target but there was none 

7, PDMOS (100,1)= Probability of true detection-report by opt imum 
7. filter at operator signal 

7, PFAMOSdOO,!) = Probability of false detection-report by optimum 
7, filter at operator signal 

7. 


7. 

7. [PDO, PFAO, PFAMOS, PDMOS] =opmach(n,Haub,D, sig) 



27 

28 function [PDO,PFA0.PFAMQS,PDMOS]=opmach(n,Hsub,D ,sig); 

29 load start 

30 [PDO,PFAQ,snrbar,sigsnr,snrexp,cl,c2,c3,c4]=opnwhite(n,sig,z,D,Nsub); 

31 CPDHOS , PFAMOS] =macliperf (sig,D, z.PDO, PFAO, Hsub, ssow) ; 

32 H=prbprb(PFA,PD): 

33 prbprbCPFAO.PDO.H.’ro'); 

34 prbprbCPFAMOS.PDMOS.H,>g-'); 

35 load fnujn; 

36 f ig=3printf (’exp#'/,l .Of ’ 


OPNWHITE 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 




'/, Function called opnuhite designed to check an operator’s effective 
y, signal-to-noise ratio (snreff) during a target recognition sequence. 

■/, The program calculates an operator’s (snr) from the error function 
y. and the operator (PD,PFA)-pair. The program then compares this value 
y. with the nominal snr (snmom) to see if the operator snreff is vithin 
y, two standard deviations of snmom. The program allows the operator as 
y, many trials for trainup as he requests. The program gives the 
y, operator the capability to adjust the signal of the experiment. 

y. 


y. 

y. INPUTS 
y. n (1.1) 
y. sig ( 1 , 1 ) 
y. D ( 1 , 1 ) 
y, Hsubd , 1 ) 
y. z(256,256) 

y. 

y. 

y. OUTPUTS 
y, snrezpd.l) 

y. 

y, sigsnrd,!) 
y. snrbard,!) 
y. PDO (1,1) 
y. PFAO (1,1) 
y. cl ( 2 , 1 ) 

y. 

y. c2 (2,1) 

y. 

y. c3 (2,1) 

y. c4 (2,1) 

y. 


=Total number of operator trials used in the experiment 
=Target signal level 
=Target radius 

=Size of background matrix to display 
=backgrotmd to display 


=Signal to noise ratio that the operator performs with 
during the experiment. 

“Standard deviation of the snmom 
“average snr expected 
“operator probability of detection 
“operator probability of false alarm 
“number of times target was present and 
detected 

mumber of times target was present and not 
detected 

mumber of times no target and no detection 
^number of times no target and false detection 


y. 


y, [PD0,PFAQ,snrbar,sigsnr.snrexp,cl,c2,c3,c4]“opnwhite(n,sig,z,D,Nsub); 


function [PDO,PFAO,snrbar,sigsnr,snrexp.cl,c2,c3,c4]“ ... 

opnwhite(n,sig,z,D,Hsub); 

pill“makeplll(Hsub,D); 

[sigsnr,snrbar,sig]“pdsnrest(n,Nsub,D,sig,z,pill); 

[cl,c2,c3,c4,flag,PDO,PFAO,snrexp]“ ... 

ezopr4(n,Nsub,D,sig,z,snrbar,sigsnr.pill) ; 


MACHPERF 

1 y.y.y.yx/.y.y.y.yx/.y.y.y.y.y.y.y.y.y.y.y.y.y.y.y.y.y.y.y.y.y.y.y.y.y.y.y.yx/.y.yx 

2 y. Function called machperf designed to analyze performance in terms 

3 y. of PD/PFA of a machine in looking for a uniform circular disc target 

4 y. with ijq>erfect, camouflage. The target is present in a background 

5 y, scene that is randomly chosen.The machine uses a set of filter 

6 y. weights to recognize targets. 

7 y. 
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8 •/. INPUTS 

9 ■/. sigm (1,1) = Input pixel value of target 

10 '/, D (1,1) = Diameter of circular disc to be used in defining 

11 •/, the filter; D must be odd. 

12 ■/. z (256,256) = Background scene 

13 ’/. PDO (1,1) = Operator probability of detection 

14 */, PFAO (1,1) = Operator probability of false alarm 

15 */, Nsub (1,H) = Size of background scene to display 

16 ■/. filt (Nsub,Hsub)= filter ueight array 

17 •/. 

18 */. OUTPUTS 

19 '/. PDMOS (100,1) = Probability of true detection-report by optimum 

20 y. filter at operator signal 

21 y. PFAMOSdOO, 1) = Probability of false detection-report by optimum 

22 y, filter at operator signal 

23 y. 

24 y. 

25 y. [PDM0S,PFAM0S]=machperf(3igm,D,z,PD0,PFA0,Msub,filt) ; 

26 

27 fxmction [PDMOS,PFAMOS]=machperf(sigm,D,z,PDO,PFAO.Nsub,filt); 

28 R=(D-l)/2; 

29 RN=(Nsub-l)/2: 

30 x=(-RH;RH).‘2; 

31 x=onea(size(x’))*x; 

32 R2=i+x’; 

33 ii=find(R2<=R'2); 

34 L=length(ii); 

35 if exist( ’ss’): 

36 pill=makepill(Hsub,D): 

37 filt=pill; 

38 else exist(’asow’): 

39 pill'=makepill(256,D); 

40 s=fft2(pill); 

41 PSD*psdgen(50,z): 

42 s30w=real(ifft2(3,/PSD)); 

43 P=(129-(Hsub-l)/2):(129+(H3ub-l)/2); 

44 3sow=ssoh(P,P): 

45 filt=ssoH; 

46 end 

47 pd=256-Naub; 

48 qd=256-Nsub; 

49 Suml= □ ; 

50 N=10000; 

51 x=a: 

52 ?=□: 

53 A=sum(filt(ii)): 

54 for b=l:N 

55 X- (RN+l)+pd*rand(l,l): 

56 y“ (RH+l)+qd*rand(l,l): 

57 Z= z(x-RH:x+RH,y-RN;y+RH): 

58 SuBl~[Suml; sumCsumCZ.efilt))]; 

59 end 

60 Sums>[Suffll Suml+sigmeA]; 

61 T=lin3pace(min(min(Sums)),max(max(Sums)),102); 

62 T(102)«n: 

63 TCD-D; 

64 PDMOS- □ ; 

65 PFAMOS-D: 

66 for b-1:100 

67 e-(T(b) < Sums); 

68 e-8um(e); 

69 PDMOS-[PDMOS e(2)/H3: 

70 PFAM0S=[PFAM0S e<l)/H]; 

71 end 


PSDGEN 
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'/, Function called psdgen used to develop a two dimensional power 
'/. spectral density (psd) from a two dimensional background scene. Based 
y, on the assumption of isotropy a one dimensional result, psd versus 
y, spatial frequency magnitude, is developed. A single scene is used and 
y. ensemble averaging is "accomplished" by averaging over a ring in 
y, spatial frequency space. The program uses spline interpolation on the 
y, calculated set of psd values to generate a two dimensional array of 
y, psd values corresponding to the frequencies of the two dimensionnal 
y, FFT of the input background scene. 

y. 


y. 

y. INPUTS 

y, N (1,1) = Number of spatial frequencies 

y, z (256,256) = Background scene 

y. 

y. 

y. OUTPUTS 

y. PSD (256,256) = 2-D version of psd 

y. 

y, PSD=psdgen(N,z) 


function PSD=p3dgen(N,z); 
zz=fft2(z)i 

k=0:127; k=Dc -fliplr(k+l)] ; 

k=ono3(256,l)*k: 

k=k,‘2; k=k+k’; k=sqrt(k); 

f=128*sqrt(2)*(l:N)/N; 

df=(f(2)-f(l))/2: 

psd= □ ; 

for n=l:H 

ii= f ind(k>f (n)-df & k<“f(n)+<if): 

psd * Cpsd sum((ab3(zz(ii))) .‘2)/langth(ii)]; 

end 

p3d(3S)=(p3d(34)+psd(36))/2; 
k=k(:); 

PSD=spline(f,psd,k); 

PSD=reshapa(PSD,256.256); 


EXOPR3 

1 uw:i;i;i:i:i:i:i:i:i:i:i:i:mi;i:m^ 

2 y, function called exopr3 used to collect operator (PD,PFA)-pairs. 

3 y. The program displays three series of target images. The first series 

4 y, displays a circular disc target in a background pattern. The second 

5 y, series displays a circular disc target in a background pattern where 

6 y, the background and target are between the minimum pixel ved.ue and the 

7 y. mean value of the pixels. The third series displays a circuleir disk 

8 y, target in a background pattern where the disc and the backgroimd 

9 '/■ pattern are between the mean background pixel value and the maTimnm 

10 y. background pixel value. The monitor display is designed to provide 

11 y, the operator with the equivalent of a color/contrast control knob. 

12 % The function collects operator performance numbers from which pd and 

13 % pfa are calculated. The data collection is based on some specified 

14 % number of separate displays. This program is designed for the 

15 'L pre-experiment stage when the operator is being trained and PD,PFA 

16 y. are being verified. 

17 y. 


number of displays 

size of the background scene for display. 

circle Diameter 

Target signal 

Random image field 

Box containing signal disc at center 


18 y. 


INPUTS 

19 y. 

n 

(1,1) 

20 y. 

Hsub 

(1.1) 

21 y. 

D 

(1,1) 

22 y. 

sig 

(1,1) 

23 y. 

z 

( 256 , 256 ) 

24 y. 

S8 

(Hsub,Hsub) 


25 y. 
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26 

27 

•/. 

•/. 

OUTPUTS 


28 

29 

7. cl 

7. 

C2,l) 

= number of times target was present and 
detected 

30 

31 

7. c2 

7. 

C2,l) 

= number of times target was present and not 
detected 

32 

7. C3 

(2,1) 

= number of times no target and no detection 

33 

7. C4 

(2,1) 

= number of times no target and false detection 

34 

35 

7. flag 

7. 

(1,1) 

= emergency exit indicator, 

(1/0 )=(e-exit/norm-end) 

36 

37 

7. PD 

7. 

(1,1) 

- Probability the target was present and the 
operator identified it 

38 

39 

40 

41 

42 

7. PFA 

7. 

7. 

7. 

(1,1) 

= Probability the target was not present but 
the operator thought it was present 


*/. [c 1, c2, c3, c4, f lag, PD, PFA] =exopr3 (n, Nsub ,D, 3ig, z, ss) 

43 

44 

45 

46 function [cl,c2,c3,c4,flag,PD,PFA]=exopr3(n,Hsub,D,sig,z,33); 

47 if n>25 n=25: end; 

48 R=(D-l)/2: 

49 cl=0;c2=0;c3=0:c4=0; 

50 cla,clg,aii3(’off’): 

51 flag=0: 

52 count=l; 

53 for k=l:n 

54 if flag = 1 end 

55 T=(rand(l,l)>0.5): 

56 cla.clg; 

57 kx”rand(l,l); 

58 while kx^l; 

59 lac=rand(l,l); 

60 end 

61 ky*rand(l,l); 

62 while ky=l; 

63 ky“rand(l,l); 

64 end 

65 Diim.SD,zpl]=iBtar(H3ub,D,z,ki,ky); 

66 zsl“zpl+(s3*8ig*T); 

67 subll=scalingl(zsl,iiin,SD, .01 ,R) ; 

68 showrCsubll,.025,.05,.14,.3, (D-l)/2); 

69 subll=scalingl(zsl,iini,SD,l,R); 

70 showrCsubll,.19,.05,.14,.3,(D-l)/2); 

71 subll=scalingl(zsl,iini,SD,1.5,R); 

72 showrCsubll,.355,.05,.14,.3,CD-I)/2); 

73 subll=scalinglCz3l,iini,SD,2,R): 

74 showrCsubll,.52,.05,.14,.3,CD-I)/2); 

75 subll-scalinglCzsl,nm,SD,2.5,R); 

76 showrCsubll,.685,.05,.14,.3,CD-l)/2); 

77 subll=scalinglCzsl,iiiii,SD,3,R): 

78 showrCsubll,.85,.05,.14,.3, CD-l)/2); 

79 

80 [imil,SDl,zp2]=iiitarCHsub,D,z,kz,k7); 

81 zs2=zp2+Css*sig*T); 

82 [subl2,scale]-scsling2Czs2,BDal,SDl,1.4,R); 

83 showrCsubl2,.025,.35,.14,.3,CD-I)/2); 

84 [subl2,scale)^scaling2Czs2,mal,SDl,Cscaletl),R) ; 

85 showr Csubl2,.19,.35,.14,.3,CD-I)/2); 

86 [subl2,scale)°scaling2Czs2,mml,SDl,Cscale42),R) ; 

87 showrCsubl2,.355,.35,.14,.3,CD-I)/2); 

88 Csubl2,scale)=scaling2Czs2,iiinil,SDl,Cscalo+3) ,R); 

89 showrCsubl2,.52,.35,.14,.3,CD-l)/2); 

90 [subl2,scale)-scaling2Czs2,mDil,SDi,Cscale-)-4) ,R); 

91 showrCsubl2,.685,.35,.14,.3,CD-I)/2); 

92 [subl2,scale) =scaling2Czs2,mml,SDl, Cscale-t-5) ,R) ; 
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93 sho«T(subl2..85,.35,.14,.3,(D-l)/2); 

94 

95 [iimi2,SD2,zp3]=mtar(Nsub,D,z,kx,ky): 

96 zs3=zp3+(ss*sig*T); 

97 [3Ubl3,scale]=scaliiig3(zs3,mm2,SD2, .5,R); 

98 showr(subl3,.025,.65..14,.3.(D-l)/2); 

99 [siibl3,scale]=scaling3(zs3,iimi2,SD2, (scale+1) ,R) ; 

100 shour(subl3,.19,.65,.14,.3,(D-l)/2); 

101 [subl3,scale]=scaling3(z33,mm2,SD2,(scale+1),R); 

102 showr(siibl3,.355, .65. .14, .3,(D-l)/2) ; 

103 [subl3,scale]=scaling3(zs3,mm2,SD2,(scale+1),R); 

104 showr(subl3,.52,.65,.14,.3,(D-l)/2); 

105 [3ubl3.scale]=scaling3(zs3,mm2,SD2,(scale+1),R); 

106 shour(subl3,.685,.65,.14,.3,(D-1)/2); 

107 [3ubl3,scala]=scaling3(zs3,mm2,SD2,(scale+1),R); 

108 showr(subl3,.85,.65,.14,.3,(D-l)/2); 

109 

110 

111 dispCtarget number is’); 

112 disp (count); 

113 tgt = inputCis there a target? [(y/n); ”(y/n) exits test loop] >>’,’s’ 

114 if (tgt==’y’l tgt—’n’) 

115 count=count+l; 

116 if T; 

117 if tgt==’y’ 

118 disp(’CORRECT’): 

119 cl=cl+l; 

120 else 

121 disp(’WRONG’); 

122 c2=c2+l; 

123 end 

124 else 

125 if tgt=’y’ 

126 disp(’WRONG’); 

127 c4=c4+l; 

128 else 

129 disp(’CORRECT’); 

130 c3=c3+l; 

131 end 

132 end 

133 else 

134 flag=l; 

135 break; 

136 end 

137 end 

138 PD=(cl)/(cl+c2); 

139 PFA=(c4)/(c3+c4); 


EXOPR4 
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mmrx/;/x/;/.7.r.mmy.y;/.7.my.y.y.y.yx/.7.r.rm 


y, function called exopr4 used to collect pd/pfa related data. This 
y. function will display three series of target Images. The first series 
y, displays a circular disc target in a background pattern. The second 
y, series displays a circular disc target in a background pattern where 
y, the background and target are between the minimum pixel value and the 
y, mean value of the pixels. The third series displays a circular disk 
y, tctrget in a background pattern where the disc and the background 
y, pattern are between the mean background pixel value and the mailmimi 
'/. background pixel value. The monitor display is designed to provide 
*/, the operator with the equivalent of a color/contrast control knob. 

'/, The function collects operator performance numbers from which pd and 
y. pfa are calculated. The data collection is based on some specified 
y. number of separate displays. This program is designed for the 
y, experiment stage when the operator (PD, PFA)-pair is collected. 

y. 


y. INPUTS 


- no- 




16 

y. n 

Cl,l) 


number of diaplays 

19 

y. IJsub 

Cl,l) 

= 

aize of the background acene for diaplay. 

20 

% D 

Cl.l) 

= 

circle Diameter 

21 

y. sig 

Cl.l) 

= 

Target aignal 

22 

y. z 

C256,256) 

= 

Background acene to diaplay 

23 

7, snmom 

Cl.l) 

- 

nominal aignal to noiae voltage ratio 

24 

7, aiganr 

Cl.l) 


standard deviation of the aignal to noiae 

25 

7. 



ratio 

26 

7. 33 

CHaub.Haub) 


Type of filter 

27 

7. 




28 

7. 




29 

7, 

OUTPUTS 



30 

7. cl 

C2.1) 

= 

number of timea target waa preaent and 

31 

7. 



detected 

32 

7. c2 

C2.1) 

= 

number of timea target waa preaent and not 

33 

7. 



detected 

34 

7. c3 

C2.1) 

= 

number of timea no target and no detection 

35 

7. c4 

C2.1) 

= 

number of timea no target and falae detection 

36 

7. flag 

Cl.l) 

= 

emergency exit indicator. 

37 

7. 



C1/0)=Ce-exit/norm-end) 

38 

7, PDO 

Cl.l) 

= 

Probability the target waa present and the 

39 

7. 



operator identified it 

40 

7. PFAO 

Cl.l) 

= 

Probability the target was not present but 

41 

7. 



the operator thought it was present 

42 

7. anrerp 

Cl.l) 

= 

Signal to noise voltage ratio of the 

43 

7. 



operator during the experiment 


44 •/, 

45 y. 

46 7. [cl,c2,c3,c4,flag,PD0,PFA0,siirexp]=exopr4(n,H3ub,D,sig, ... 

47 z,snmom,sigsnr,ss) 

48 

49 function Ccl,c2,c3,c4,flag,PDQ,PFA0,snrexp]=exopr4(n,H3ub,D,sig, ... 

50 2,3nniom,aigsnr,33): 

51 R=(D-l)/2; 

52 cl=0;c2=0;c3=0:c4=0! 

53 cla,clg,aiis(’off: 

54 flag=0: 

55 count=l; 

56 for k=l:n 

57 if flag = 1 end 

58 T=(rand(l,l)>0.5); 

59 cla.clg; 

60 kx=rand(l,l); 

61 while ki=l: 

62 kx*rand(l,l); 

63 end 

64 ky=rand(l,l): 

65 while ky**l; 

66 ky^andCl.l): 

67 end 

68 Ciim,SD,zpl]=iiitar(Hsub,D,z,kx,k 7 ); 

69 zsl“zpl+(8a*aig*T); 

70 3 ubll=acalinglCzsl,nm,SD,.01,R); 

71 ahowrCaubll,.026,.05,.14,.3,(D-l)/2); 

72 subll=acalingl(zal,iim,SD,l,R); 

73 ahowrCaubll,.19,.05,.14,.3,(D-l)/2); 

74 subll=3calingl(z3l,nBi,SD,1.5,R); 

75 ahowrCsubll,.355,.05,.14,.3,(D-l)/2); 

76 subll=8calingl(zsl,iim,SD,2,R); 

77 ahowrCaubll,.52,.05,.14,.3,CD-l)/2); 

78 subll=3C8LlinglCz3l,iim,SD ,2.5,R); 

79 ahowrCaubll,.685,.05,.14,.3,CD-l)/2); 

80 3ubll=3calinglCzsl,iiiii,SD,3,R); 

81 ahowrCaubll,.85,.05,.14,.3,CD-l)/2); 

82 

83 [niBl,SDl,zp2]=ntarCHaub,D,z,ki,ky): 

84 zs2=zp2+Ca3*aig*T); 

85 [3ubl2,3cale!l-8caling2Cz32,miil,SDl,1.4,R); 
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86 

87 

88 

89 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 
100 
101 
102 

103 

104 

105 

106 

107 

108 

109 

110 
111 
112 

113 

114 

115 

116 

117 

118 

119 

120 
121 
122 

123 

124 

125 

126 

127 

128 

129 

130 

131 

132 

133 

134 

135 

136 

137 

138 

139 

140 

141 

142 

143 

144 

145 

146 

147 

148 

149 

150 

151 

152 

153 


showr(subl2,.025,.35,.14..3,(D-l)/2); 

[subl2,scale] =scaling2(zs2,mml ,SD1, (scale-t-1) ,R) ; 
showr(subl2,.19,.35,.14,.3,(D-1)/2); 

[subl2,scale]=scaling2(zs2,mml,SD1,(scale+2),R); 
showr(subl2,.355,.35,.14,.3,(D-l)/2) ; 

[subl2,scale]=scaling2(zs2,mml,SD1,(scale+3),R); 
showr(subl2,.52,.35,.14,.3,(D-l)/2); 
[subl2,scale]=3calirig2{zs2,imnl,SDl, (scale+4) ,R); 
showr(subl2,.685,.35,.14,.3.(D-l)/2); 

[subl2,scale]=scaling2(zs2,mml,SD1,(scale+5),R)j 
showr(subl2,.85,.35,.14,.3,(D-1)/2); 

[nmi2,SD2,zp3]=mtar(Hsub,D,z,lac,ky); 
zs3=zp3+(ss*sig*T); 

Csubl3, scale] =scaliiig3 (zsS ,mm2, SD2,1, R) ; 
showr(subl3,.025,.65,.14,.3,(D-l)/2); 
[subl3,scale]=scaliiig3(zs3,mm2,SD2, (scale+.5) ,R); 
showr(3ubl3,.19,.65,.14,.3,(D-l)/2); 

[subl3,scale]=scaling3(zs3,mm2,SD2,(scale+.75),R) ; 
showr(subl3,.355,.65,.14,.3,(D-1)/2); 

[3ubl3,scale]=scaling3(z33,mm2,SD2,(scale+1),R); 
showr(3ubl3,.52,.65,.14,.3,(D-l)/2); 

[3ubl3,scale] =3caliiig3(zs3,mm2,SD2, (scale+1.5) ,R); 
showr(subl3,.685,.65,.14,.3,(D-1)/2); 

[subl3,scale]=scaling3(z33,mm2,SD2,(scale+2),R) ; 
showr(3ubl3,.85,.65,.14,.3,(D-1)/2); 


di3p(’target number is’); 
disp (count); 

tgt = input(’is there a target? C(y/n); ... 

"(y/n) exits test loop] >>’,’ 3 ’); 
if (tgt==’y’l tgt=-’n’) 
count=count+l; 
if T; 

if tgt==’y’ 

disp(’CORRECT’): 
cl=cl+l; 
else 

disp(’WRONG’); 
c2=c2+l: 

end 

else 

if tgt==’y’ 

disp(’WRONG’): 
c4=c4+l; 
else 

disp(’CORRECT’); 
c3=c3+l; 

end 

end 

if count=floor(n/5) I count=floor(2*n/5) I count= ... 
floor(3*n/5) 1 count==floor(4*n/5) |count==n: 

[PDO ,PFA0, snrexp .flag] =check(cl, c2, c3, c4, snmom, sigsnr) 
save opwdata cl c2 c3 c4 PDO PFAO snrexp sigsnr sig ... 
snmom D Nsub; 

writefil(count,c1,c2,c3,c4,snrexp,PDO,PFAO.sigsnr.sig, 
snmom ,D, Nsub) ; 

else 

PD0”cl/(cl+c2); 

PFA0=c4/(c3+c4); 

if PD0<1 & PDO>0 k PFA0<1 tPFA0>0 
t2sig=erfinv(l-2*PFA0); 
snrexp=sqrt(2)*(t2sig-erfinv(1-2+PDO)); 
sprintf(’PD0:7,5.4f PFA0:7,5.4f snrexp: */.5.4f ’, ... 

PDO,PFAO,snrexp) 

end 

end 

if flag”l break; end 
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154 else 

155 flag=l; 

156 break; 

157 end 

158 end 

159 PD0=(cl)/(cl+c2); 

160 PFA0=(c4)/(c3+c4); 

161 t2sig=erfinv(l-2*PFA0); 

162 snreip=sqrt(2)*(t2sig-erfinv(l-2*PD0)); 
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% function called opmach designed to run opuhite and machperf. 

% The program obtains operator and machine probability of detection, 
■/. probability of false alarm and graphs them for comparison. 

•/. 


•/. 


•/. INPUTS 
•/. sig (1,1) 

•/. D (1,1) 

y. 

•/. n (1,1) = 

*/, Hsub (l,num) = 

•/. 

y. 

y, OUTPUTS 

y. pDo (1,1) = 

y. PFAQ (1,1) = 

y. 

y. PDMQS (100,1) = 

y. 

y. PFAH0S( 100,1) = 

y. 

y. 


Input pixel value of target 

Diameter of circular disc to be used in defining the 

filter; D must be odd. 

number of displays 

number of pixels on the x aixis. 


Probability the operator had a true detection 
Probability the operator thought there was a 
target but there was none 

Probability of true detection-report by optimum 
filter at operator signal 

Probability of false detection-report by optimum 
filter at operator signal 


y. 

y, [PDO,PFAQ,PFAMOS ,PDH0S]=opmach(n,Haub,D ,sig) 


funct ion [PDO, PFAO, PFAMOS, PDMOS] =opoiach(n, Nsub, D, s ig) ; 
load start 

[PDO,PFAO,snrbar,sigsnr,snrexp,cl,c2,c3,c4]=opnwhite(n,sig,z,D,Hsub); 
[PDMOS,PFAMOS]=machparf(sig,D,z,PD0,PFAO,Hsub,ssow); 

H=prbprb(PFA,PD); 
prbprb(PFAO,PDO,H,’ro’): 
prbprb(PFAMOS,PDMOS,H,’g-'): 
load fnum; 

f ig=8printf (’ exp#'/,!. Of ’, fnum) 


PDGEN 

2 % Function called PDgen used to calculate a set of random error 

3 y, results for the estimated PDO, PFAO operator 

4 */, performance results. 

5 •/. 

6 •/. 


7 

•/, INPUTS 


8 

•/. n (1,1) 

= number of trials 

9 

•/. Hsub (1,1) 

= size of background matrix to display 

10 

•/. sig (1,1) 

= target signal level 

11 

•/. pill (1,1) 

= box containing the signal disc at the center 

12 

•/. D (1,1) 

= target diameter 

13 

•/. z (266,256) 

= backgroimd to display 

14 



15 

•/. OUTPUTS 


16 

•/, sigsnr(1,1) 

= standard deviation of random snr results 
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17 ■/, snrbarCl,!) = mean value of random snr results 

18 */. sig (1,1) = target signal level to conduct experiment with 

19 •/. 

20 ‘/. [PDQ,PFAO]=PDgen(n,Hsub,D,sig,z,pill,H) 

21 

22 function [PD0,PFA0]=PDgen(n,Nsub,D,sig,z,pill) 

23 [cl,c2,c3,c4,flag,PD0,PFAQ]=exopr3(n/5,H3ub,D,sig,z,pill); 

24 sprintfCPDQ is ;y.5.4f PFAQ is;y.5.4f' ,PDQ,PFA0) 

25 more = inputC’do you want to try again? (y/n) ; »’,’s’); 

26 while more == ‘y‘ 

27 nn=input(’enter number of trials to conduct’); 

28 3ig2=input(’enter the signal you want to use’); 

29 [cl,c2,c3,c4,flag,PDQ,PFA0]=exopr3(nn,Hsub,D,3ig2,z,pill); 

30 sprintfC’PDO is :y.5.4f PFAQ i3:y.5.4f ’ ,PD0,PFAQ) 

31 more = inputC’do you want to try again? (y/n); »’,’s’); 

32 end 

33 if more==’n’& PDQ=1 

34 PD0=.999; 

35 elseif mora=’n’ft PFAQ=0 

36 PFAQ=.001; 

37 end 
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y. Function called pdsnrest used to calculate a set of random error 
y, results for the operator (PD,PFA)-pair. 

y. 


y. INPUTS 
•/. n (1,1) = 

y. Hsub (1,1) = 

y, sig ( 1 , 1 ) = 
y. pill ( 1 , 1 ) = 
y. M (1,1) = 
y. D (1,1) = 

y, z (256,256) = 

y. 

y. OUTPUTS 
y, sigsnrd,!) = 
y, snrbard,!) = 

y, sig ( 1 , 1 ) 

y. 


uumber of trials 

size of background matrix to display 
target signal level 

box containing the signal disc at the center 
number of monte carlo simulations to be run 
target diameter 
background to display 


standard deviation of random snr results 

mean value of random snr results 

target signal level to conduct experiment with 


y, [sigsnr,snrbar, sig] =pdsnrest(n,Hsub,D,sig,z,pill ,H) 


function [sigsnr,snrbar,sig]=pdsurest(n,Hsub,D,sig,z,pill,M); 
if "existCM’); H=le3; end 

[cl,c2,c3,c4,flag,PDQ,PFAQ]=exopr3(n/5,Hsub,D,sig,z,pill); 
sprintf(’PD0 is :y.5.4f PFAQ is:7,5.4f ’ ,PDO,PFA0) 
more = inputCdo you want to try again? (y/n); »’,’s’); 
while more = ’y’ 

nn”input(’enter nuid>er of trials to conduct’); 
slg2=input(’enter the signal you want to use’); 

[cl,c2,c3,c4,flag,PDQ,PFAQ]=exopr3(im,Hsub,D,sig2,z,pill) ; 
sprintf(’PDa is ;y,5.4f PFAQ is:y,5.4f ’ ,PD0,PFA0) 
more = input(’do you want to try again? (y/n); »’,’s’): 
end 

if more==’n’ h PD0<1 t PFAQ>0 
hN=n/2; 

R=randd ,hH*M) ; 
ii=R<PD0; 

ii=reahapo(ii,hH,M); 

TT=sum(ii); 

R=rand(l,hH*M); 
pnfanom=PD0; 
ii=R<pnf anom; 
ii=reshapo(ii,hH,M); 
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44 ^=311111(11); 

45 ii=find(TT==hNlTT==0): 

46 TT(ii) = n: 

47 mi(ii) = n: 

48 ii=fiiid(NN==hNiNN==0): 

49 TT(ii) = n: 

50 NN(ii) = n; 

51 PD=TT/hH; 

52 PFA=l-HH/liN; 

53 t2sig=erfinv(l-2*PFA); 

54 s23ig=-erf inv(l-2+PD)+t2sig; 

55 raiisnr=32sig+sqrt(2) ; 

56 snrbar=mean(ransiir); 

57 sigsnr=std(raiisnr); 

58 if exist(’sig2’) 3ig=sig2: end 

59 A=100; 

60 CQ , H =M3t (ransnr, A) ; 

61 Q=q(l:A-l): 

62 X=X(1:A-1): 

63 Q=cuiii3um(Q) : 

64 Q=q/q(length(Q)): 

65 linprb(q,X); 

66 figure(gcf): 

67 end 
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'/, Function called psdgen used to develop a two dimensional power 
•/, spectral density (pad) from a two dimensional background scene. Based 
'/. on the assuB^tion of isotropy a one dimensional result, pad versus 
*/, spatial frequency magnitude, is developed. A single scene is used and 
•/, ensemble averaging is "accomplished" by averaging over a ring in 
■/, spatial frequency space. The program uses spline interpolation on the 
*/, calculated set of psd values to generate a two dimensional array of 
*/, psd values corresponding to the frequencies of the two dimensionnal 
'/, FFT of the input background scene. 

•/. 

•/. 

•/, INPUTS 

"/, H (1,1) = Number of spatial frequencies 

'/. z (256,256) = Background scene 

•/, 

•/. 

'/, OUTPUTS 

•/, PSD (256,256) = 2-D version of psd 

•/. 

y, PSD-psdgon(N,z) 

function PSD=psdgen(N,z); 
zz='fft2(z); 

k=0:127; k=*Dc -fliplr(k+l)] ; 

k=onea(256,l)*k; 

k“k .'2; k-k+k’; k=sqrt(k); 

f=128*sqrt(2)*(l:N)/N; 

df»(f(2)-f(l))/2; 

p3d=*n ; 

for n=l:H 

ii” f ind(k>f(n)-df t k<=f(n)+df); 
psd = [psd sum((aba(zz(ii))).‘2)/length(ii)]; 
end 

psd(35)=(psd(34)+psd(36))/2; 
k=k(:) : 

PSD=spline(f,psd,k); 

PSD=reshape(PSD,256,256); 
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APPENDIX C SPOTC 


This appendix contains a printout of the programs written which support experiment 3. This 
experiment uses SPOT background images. The control program is OPMACH. This program calls 
programs called OPCA.M and MACHPERF. The OPCAM program collects the operator (Pd,Pfa)- 
pair and the MACHPERF program collects the machine (PD,PF. 4 )-pairs. 

The OPCAM program provides the operator with a training phase then when the operator 
feels comfortable with target recognition the program begins the experimental phase. The OP¬ 
CAM program interfaces with the operator through the keyboard and the computer monitor. The 
computer monitor displays eighteen target/background images, and a decision box for the opera¬ 
tor to input his choice of target present or not present. OPCAM calls the programs MAKEPILL, 
PDSNREST and EXOPR3. PDSNREST estimates the effective (PD,PFA)-pMr of an xperiment. 
PDSNREST allows the operator to have as many training trials as he requests. The program also 
allows the operator to adjust the target signature strength so that the effective (PD,PFA)-pair is 
close to the nominal (PD,PFA)-pair. The PDSNREST calls the program EXOPR3 which serv'es as 
the interface between the monitor and the operator and collects/calculates the operator effective 
(PD,PFA)-pair. The EXOPR4 program serves as the interface between the operator and the com¬ 
puter monitor for the experimental data collection phase of the experiment. This program collects 
the effective (PD,PFA)-pair collected as data. EXOPR4 calls the programs CHECK, WRITEFILE, 
CAMO, SHOW, SCALE(1,2,3), MTAR. MTAR adds a target of uniform signature to the back¬ 
ground pixels. The MACHPERF program contains the algorithm to implement the machine/filter. 
The MACHPERF program in effect offers the same target/background definitions and parameters 
to the machine/filter as those shown to the operator. The MACHPERF program calls the programs 
PSDGEN, MAKEPILL, CAM. MAKEPILL and CAM serve the same purpose as in the operator 
collection phase. The program PSDCEN calctolates the background matrix spatial frequency power 
spectral density (PSD) which is then used to implement the optimum linear filter. 


EXPERIMENT 3 


OPMACH 


% function called opmacti designed to run opvhite aoH macl^orf. 

L The program obtains operator and machine probability of detection, 
yf probability of false alarm and graphs them for comparison. 

*/. 

•/. 

•/. IHPUTS 


8 

'/. sig 

(1,1) 

= Input pixel value of target 

9 

•/. D 

(1,1) 

- Diameter of circular disc to be used in defining 

10 

•/. 


the filter; D must be odd. 

11 

7. n 

(1,1) 

3 number of displays 

12 

Hsub 

(1 ,nnm) 

= number of pixels on the x axis. 

13 

7. 



14 

7. 



15 

7. OUTPUTS 


16 

7. PDO 

(1,1) 

= Probability the operator had a true detection 

17 

7. PFAO 

(1,1) 

= Probability the operator thought there was a 

18 

7. 


target but there was none 

19 

7. PDMOS 

(100,1) 

= Probability of true detection-report by optimum 

20 

7. 


filter at operator signal 

21 

7. PFAMOSC 100,1) 

= Probability of false detection-report by optimum 

22 

7. 


filter at operator signal 

23 

7. 



24 

7. 



25 

*!% CPDO ,PFA0 ,PFAM0S»PDMOS!) =opoiachCiit Nsub,D, sig) 

26 
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27 

28 function [PDO,PFA0,PFAMQS.PDMOS,signi]=opmach(n,Hsub,D,sig) ; 

29 load start; 

30 [PDO,PFAO,snrbar,sigsnr,snrexp,cl,c2,c3,c4]=opcam(n,sig,z,D,Nsub); 

31 [PDHOS,PFAM0S,sigm]^machperf(sig.D,z,PDO,PFAO,Nsub ,ssow); 

32 H=prbprb(PFA,PD); 

33 prbprb(PFAO,PDO,H,’ro'): 

34 prbprbCPFAMOS,PDMOS,H,^g*O; 

35 load fnum; 

36 f ig=sprintf (’exp#'/.l .Of ’ ,fiium) 
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*/, Function called opcam designed to check the efffective 
y, signeil-to-noise (snreff) of an experiment. The function calculates an 
*/. operator,s snreff from the error function and the calculated 
y, (PD,PFA)-pair. The program then conqjares this value uith nominal 
y, signal-to noise-ratio (snmom) of the to see if the operator is 
y. within an acceptable limit (2 standard deviations). 


y. 


y. 


y. INPUTS 

y. n (1,1) =Total number of operator trials used in the experiment 
y, sig (1,1) =Target signal level 

y, D (1,1) =Target radius 

y, Msub (1,1) =Si 2 a of background matrix to display 
y, z (256,2S6)=background to display 


OUTPUTS 

snrexpd,!) = Signal to noise ratio that the operator performs uith 
during the experiment, (snreff) 
sigsnrd,!) = Standard deviation of the snmom 
snrbard.l) = average snmom 

PDO (1,1) = operator probability of detection 

PFAO (1,1) = operator probability of false alarm 

cl (2,1) = number of times target was present and 
detected 

c2 (2,1) = number of times target was present and not 
detected 

c3 (2,1) = number of times no target and no detection 

c4 (2,1) = number of times no target and false detection 


y. 

y. [PDO,PFAO,snrbar,sigsnr,snrexp,cl,c2,c3,c4]=opcam(n,sig,z,D,Nsub) ; 


function [PDO,PFAO,snrbar,sigsnr,snrexp,cl,c2,c3,c4]= ... 

opcam(n,sig,z,D,Nsub); 
pill=makepill(Nsub,D); 

[sigsnr,snrbar,sig]>pdsnrest(n,Nsub,D,sig,z,pill); 

[cl,c2,c3,c4,flag,PDO,PFAO,snraxp]=exopr4(n,Hsub,D,sig,z, ... 
snrbar,sigsnr,pill); 


MACHPERF 
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y. Function called machperf designed to analyze performance in terms 
y. of PD/PFA of a machine in looking for a uniform circular disc target 
y, with isperfect camouflage. The target is present in a background 
'/, scene that is randomly chosen.The machine uses a set of filter 
y, weights to recognize targets. 

y. 

y. 

y. INPUTS 
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10 '/. sig (1,1) = Input pixel value of target 

11 '/, D (1,1) = Diameter of circular disc to be used in defining 

12 */, the filter; D must be odd. 

13 ■/. z (256,256) = Background scene 

14 '/, PDO (1,1) = Operator probability of detection 

15 '/, PFAO (1,1) = Operator probability of false alarm 

16 '/. Hsub (1,N) = Size of background scene to display 

17 */. filt (Nsub,Nsub)= filter weight array 

18 •/. 

19 •/. OUTPUTS 

20 y, PDHOS (100,1) = Probability of true detection-report by optimum 

21 y. filter at operator signal 

22 y, PFAMOSdOO, 1) = Probability of false detection-report by optimum 

23 y. filter at operator signal 

24 y, sigm (1,1) = signal machine needed to match the operator 

25 y, performance 

26 y, 

27 y. 

28 y. 

29 y, [PDHOS,PFAMQS,sigm]=machparf(sig,D,z,PDO,PFAO,Hsub,filt): 

30 

31 function [PDHOS,PFAM0S,3igm]=machperf(sig,D,z,PDO,PFAO,Nsub,filt); 

32 sigBFsig; 

33 R=(D-l)/2; 

34 RH=(H3ub-l)/2: 

35 x=(-RH:RH).'2; 

36 x=onaa(aize(x’))*z: 

37 R2=x+x>; 

38 ii=find(R2<=R‘2): 

39 L=length(ii); 

40 if exist( ’ss’): 

41 pill^makapill(Hsub,D); 

42 filt=pill: 

43 else exist(’ssow’); 

44 pill=makepill(256,D); 

45 s='fft2(pUl): 

46 PSD=psdgen(50,z); 

47 ssow=real(ifft2(3./PSD)): 

48 P=(129-(Hsub-l)/2);(129+<Hsub-l)/2); 

49 ssow=ssow(P,P); 

50 filt=3Sow; 

51 end 

52 pd=256-Nsub; 

53 qd=256-H3ub; 

54 Suml= □ ; 

55 H=1000; 

56 x=n: 

57 y= □ ; 

58 A=sum(filt(ii)); 

59 for b=l:N 

60 X* (RN+l)+pd*reuid<l,l); 

61 y” (RN+l)+qd*rand(l,l); 

62 cajB~camo(0,z,rand(l,l) ,rand(l,l)); 

63 Z= z(x-RH:x+RH,y-Rll:y+RH); 

64 Suml-[Suml; sum(sum(Z.*filt))]; 

65 Z(li)-ones(size(Z(ii)))*mean(Z(ii))+cam; 

66 Su]i2~[Su]ii2; sum(sum(Z.*f ilt))] ; 

67 and 

68 Sums= [Suml Sujn2-t-sigm*A] ; 

69 T=llnspace(miii(mln(Sums)) ,max(max(Sums)) , 102) ; 

70 T(102) = n: 

71 T(l)=n; 

72 PDHOS” □ ; 

73 PFAMOS-D; 

74 for b=l:100 

75 e”(T(b) < Sums); 

76 e”sum(e); 

77 PDHOS” [PDHOS e(2)/H]: 
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78 PFAMOS= [PFAMQS eCD/Nl; 

79 end 
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*/, Function called psdgen used to develop a two dimensional power 
spectral density (psd) from a two dimensional background scene. 

Based on the assuag>tion of isotropy a one dimensional result, psd 
versus spatial frequency magnitude, is developed. A single scene is 
used and ensemble averaging is "accon 5 )lished“ by averaging over a 
ring in spatial frequency space.The program uses spline interpolation 
on the calculated set of psd values to generate a two dimensional 
array of psd values corresponding to the frequencies of the two 
dimensionnal FFT of the input background scene. 


•/. 


•/. 

*/. IHPUTS 

*/, N (1,1) = Number of spatial frequencies 

y. z (256,256) = Background scene 

•/. 

•/. 

y. OUTPUTS 

y. PSD (256,256) = 2-D version of psd 

y. 

y, PSD=psdgen(N,z) 


function PSD=psdgen(N,z); 
zz=fft2(z): 

k=0:127: k=Ck -fliplr(k+l)]; 

k=one3(256,l)*k; 

k=k.'2; k=k+k’: k=sqrt(k); 

f=128*sqrt(2)*(l:N)/H; 

df=(f(2)-f(l))/2! 

psd^O: 

for n“l:H 

ii= f ind(k>f (n)-df tc k<=f(n)+df); 

psd = [psd sum((ab3(zz(ii))).■2)/length(ii)] ; 

end 

psd(35)=(psd(34)+psd(36))/2; 
k=k(:); 

PSD=splina(f,p3d,k); 

PSD=re3hapa(PSD,256,256); 
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y, function called ezopr3 used to collect pd/pfa related data. This 
y, function will display three series of target images. The first series 


y, displays a circular disc target in a background pattern. The second 
y, series displays a circular disc target in a background pattern where 
"U the background and target are between the mininnim pixel value and the 
y, mean value of the pixels. The third series displays a circular disk 
y, target in a background pattern where the disc and the background 
y, pattern are between the mean background pixel value and the maximum 
y, background pixel value. The monitor display is designed to provide 
y, the operator with the equivalent of a color/contrast control knob, 
y. The function collects operator performance numbers from which pd and 
y, pfa are cedculated. The data collection is based on some specified 
y, number of separate displays. This program is designed for the 
y, pre-experiment stage when the operator is being trained and PD,PFA 
y, are being verified. 

y. 


y, INPUTS 

y. n ( 1 , 1 ) 

y, Hsub ( 1 , 1 ) 

y. D ( 1 , 1 ) 


= number of displays 

= size of the background scene for display. 
= circle Diameter 
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22 '/, sig (1,1) = Target signal 

23 */, z (256,256) = Random image field 

24 ■/, ss (Nsub,Nsub)= Box containing signal disc at center 

25 •/. 

26 •/. 

27 •/. OUTPUTS 

28 */. cl (2,1) = number of times target was present and 

29 ■/. detected 

30 */. c2 (2,1) = number of times target was present and not 

31 */. detected 

32 ‘/, c3 (2,1) = niimber of times no target and no detection 

33 y, c4 (2,1) = number of times no target and false detection 

34 y, flag (1,1) = emergency exit indicator, 

35 y. (l/0)=(e-exit/norm-end) 

36 y. PD (1,1) = Probability the target was present and the 

37 y, operator identified it 

38 y. PFA (1,1) = Probability the target was not present but 

39 y, the operator thought it was present 

40 y. 

41 y. 

42 y, [cl, c2 ,c3, c4 ,f lag,PD ,PFA]=exopr3(n,H3ub,D,sig,z,ss) 

43 

44 

45 

46 function Ccl,c2,c3,c4,flag,PD,PFA]=exopr3(n,Hsub,D,sig,z,ss); 

47 if n>25 n=25: end; 

48 R=(D-l)/2i 

49 cl=0;c2=0;c3=0;c4=0; 

50 cla,clg,aiis(’off’): 

51 flag=0i 

52 count'lj 

53 for k=l;n 

54 if flag == 1 and 

55 T=(rand(l,l)>0.5): 

56 cla.clg; 

57 kx=rand(l,1); 

58 while kx==l; 

59 kx=rand(l,1); 

60 end 

61 ky=rand(l,l); 

62 while ky==l; 

63 ky”rand(l,l): 

64 end 

65 if T cam=camo(D,z,kx,ky);end 

66 jj=find(ss==l); 

67 [mm,SD,zpl]=mtar(Nsub,D,z,ki,ky): 

68 if T zpl(jj)=maan(zpl(jj))+cam; end; 

69 zsl=zpl+(3s*aig*T); 

70 3ubll=scalingl(zsl,mm,SD,.01,R); 

71 showr(subll,.025,.05,.14,.3,(D-l)/2); 

72 subll=scalingl(zsl,iim,SD,l,R); 

73 ahowr(3ubll,.19,.05,.14,.3,(D-l)/2); 

74 subll=scalingl(zal,mm,SD,1.5,R): 

75 3howr(3ubll,.356,.05,.14,.3.(D-l)/2); 

76 subll=scalingl(zsl,mm,SD,2,R); 

77 showr(subll,.52,.05,.14,.3.(D-l)/2); 

78 subll=scalingl(zsl,mm,SD,2.5,R); 

79 showrCsubll,.685,.05,.14,.3.(D-l)/2); 

80 subll=scalingl(zsl,mm,SD,3,R); 

81 showrCsubll,.85,.05,.14,.3,(D-l)/2): 

82 

83 [mml,SDl,zp2]=]iitar(Hsub,D,z,kz,ky); 

84 if T zp2(jj)=mean(zp2(jj))+cajB: end; 

85 z32=zp2+(ss*sig*T); 

86 [3nbl2,scale]=scaling2(zs2,mm1,SD1,1.4,R) ; 

87 showr(subl2,.025,.35..14,.3,<D-l)/2); 

88 [subl2,scale]=scaling2(zs2,mml,SDl,(scaletl),R); 

89 showr(3ubl2,.19,.35,.14,.3,(D-1)/2); 
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90 

91 

92 

93 

94 

95 

96 

97 

98 

99 
100 
101 
102 

103 

104 

105 

106 

107 

108 

109 

110 
111 
112 

113 

114 

115 

116 

117 

118 

119 

120 
121 
122 

123 

124 

125 

126 

127 

128 

129 

130 

131 

132 

133 

134 

135 

136 

137 

138 

139 

140 

141 

142 

143 

144 

145 

146 

147 


[subl2.scale] =3caling2(zs2,iimil,SD1,(scale+2) ,R) 
sliowrCsubi2, .355, .35, .14. .3, (D“l)/2) ; 

[subl2,scale]=scaling2(zs2,imnl,SD1,(scale-i-3) ,R) 
Stour(subl2,.52,.35,.14,.3,(D-l)/2); 

[subl2 .scale] =scaling2(zs2.nrnil,SDl,(scale+4) ,R) 
showr(subl2,.685,.35,.14,.3.(D-1)/2); 

[subl2,scale]=scaliiig2(zs2,mml,SD1,(scale+5) ,R) 
showr(subl2,.85,.35,.14,.3,(D-l)/2); 


[imB2,SD2,zp3]=mtar(Nsub,D,z,kx,k7) : 
if T zp3(jj)=meaii(zp3(jj))+cam; end; 
zs3=zp3+(ss*aig*T); 

[!subl3 ,sceJ.e]=scaling3(zs3,mm2,SD2, .5,R) ; 
showr(subl3,.025,.65,.14,.3,(D-l)/2); 

C3ubl3,scale] =scaliiig3(z33 ,mm2,SD2, (3cale+l) ,R).; 
showr(3ubl3,.19,.65,.14,.3,(D-l)/2); 

[subl3,scala]=scaling3(z33,!imi2,SD2,(scale+1) ,R); 
showr(subl3,.355,.65,.14,.3,(D-l)/2); 
[aubl3,scale]=3caling3(z33,imn2,SD2,(scale+1) ,R) ; 
showr(subl3,.52,.65,.14,.3,(D-l)/2); 
[3ubl3,3cale]=3caling3(zs3,mm2,SD2,(scale+1),R); 
showr(subl3,.685,.65,.14,.3,(D-l)/2); 

Caubl3,scale]=acaling3(z33,mm2,SD2,(scale+1),R); 
3howr(subl3,.85,.65,.14,.3,(D-l)/2); 


dispCtarget ntimber is’); 
disp (count); 

tgt = input(’is there a target? [(y/n); '(y/n) exits test loop] 
... »>,’s’); 

if (tgt=»’y’l tgt«=«’n’) 
count=count+l; 
if T; 

if tgt«=’y’ 

di8p(’CORRECT’); 
cl=cl+l; 

else 

disp(’WRONG’); 
c2=c2+l; 

end 

else 

if tgt=”’y’ 

di3p( ’WRONG’); 
c4=c4+l; 

else 

disp(’CORRECT’); 
c3*c3+l; 

end 

end 


else 

flag=l; 

break; 

end 


end 

PD=(cl)/(cl+c2); 
PFA=(c4)7(c3+c4) ; 


EXOPR4 



3 % function will display three series of target images. The first series 

4 % displays a circular disc target in a background pattern. The second 

5 '/, series displays a circular disc target in a backgromd pattern where 

6 */, the background and target are between the minimum pixel value and the 
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7 '/, mean value of the pixels. The third series displays a circular disk 

8 ■/. target in a background pattern where the disc and the background 

9 % pattern are between the maximum background pixel value and the 

10 '/. maximum backgroimd pixel value. The monitor display is meant to 

11 '/. provide the operator with the equivalent of a color contrast control 

12 '/. knob. The function collects operator performance numbers from which 

13 '/, pd and pfa are calculated.The data collection is based on some 


14 

specified number of separate displays. The collects the operator 

15 

(PD,PFA)-] 

pair for an 

for an experiment. 

16 

!. 

INPUTS 


17 

'/, n 

(1,1) 

= number of displays 

18 

■/. Nsub 

(1,1) 

= size of the background scene for display. 

19 

■/. D 

(1,1) 

= circle Diameter 

20 

■/. sig 

(1,1) 

= Target signal 

21 

/. z 

(256,256) 

= Background scene to display • 

22 

y. snmom 

(1,1) 

= nominal signal to noise voltage ratio 

23 

y. sigsnr 

(1,1) 

= standard deviation of the 

24 

y. 


signal-to-noise ratio 

25 

y. S3 

(Hsub ,Hsiib) 

= Box containing signal disc at center 

26 

y. 



27 

y. 



28 

y. 

OUTPUTS 


29 

y. cl 

(2,1) 

= number of times target was present and 

30 

y. 


detected 

31 

y. c 2 

(2,1) 

= number of times target was present and not 

32 

y. 


detected 

33 

y. c3 

(2,1) 

- number of times no tctrget and no detection 

34 

y. c4 

(2,1) 

= number of times no target and falsa 

35 

y. 


detection 

36 

y. flag 

(1,1) 

= emergency exit indicator. 

37 

y. 


(l/0)=(e-exit/norm-end) 

38 

y. PDo 

(1,1) 

= Probability the target was present and the 

39 

y. 


operator identified it 

40 

y, PFAQ 

(1,1) 

= Probability the target was not present but 

41 

y. 


the operator thought it was present 

42 

y, snrexp 

(1.1) 

= Signal to noise voltage ratio of the 

43 

y. 


operator during the experiment 

44 

y. 



45 

y. 



46 

y, [cl,c2,c3 

,c4,flag,PDO,PFA0.snrexp]=ezopr4(n,Hsub,D,sig,z, ... 


47 */■ snmom,sigsnr,ss) 

48 

49 function [cl,c2,c3,c4.flag,PD0,PFA0,snrexp]=exopr4(n,Hsub,D,sig,z, ... 

50 snmom,sigsnr,ss); 

51 R=(D-l)/2: 

52 cl=0;c2=0:c3=0;c4=0! 

53 cla,clg,aiis(’off’): 

54 flag=0; 

55 count=l; 

56 for k=l:n 

57 if flag “ 1 end 

58 T>(rand(l,l)>0.5); 

59 cla.clg; 

60 lomrandCl,!); 

61 while ki™!: 

62 kx=rand(l,l); 

63 end * 

64 ky=rand(l,l): 

65 while ky=l; 

66 ky^andCl.l); 

67 end 

68 if T ca]ii~camo(D,z,kx,ky) ;end 

69 j j*find(ss”l); 

70 Diim,SD,zpl]=mtar(Hsub,D,z,kz,ky); 

71 if T zpKjj)=mean(zpl(jj))+cam;end 

72 zsl*=zpl+(as*sig+T); 

73 3ubll=scallngl(z3l,iiin,SD, .01,R); 

74 3howr(subll,.025,.05,.14,.3,(D-l)/2); 
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75 subll=scalingl( 2 sl,nim,SD, 1 ,R) ; 

76 shovrCsubll..19,.05,.14,.3,(D-l)/2); 

77 subll=scaliiigl(zsl,iiim,SD,1.5,R); 

78 sbowrCsubll,.355,.05,.14,.3,(D-l)/2); 

79 sTibll=scaliiigl(z3l ,min,SD ,2,R) ; 

80 sliowr(subll,.52. .05,.14, .3,(D-l)/2) ; 

81 3ubll=scalingl(zsl,mm,SD,2.5,R); 

82 showr(subll,.685,.05,.14,.3,CD-I)/2); 

83 subll=scalinglCzsl ,nim,SD,3,R); 

84 sbowr(subll,.85..05,.14,.3,(D-l)/2); 

85 

86 l!mml,SDl ,zp2]=i[ttar(N3ub,D ,z,ki,ky) ; 

87 if T zp2(jj)=inean(zp2(jj))+cani:eiid 

88 Z32=zp2+(ss+sig*T); 

89 [3Ubl2,scale] =scaliiig2(z32,mml ,SD1,1.4,R) ; 

90 sbovr(subl2,.025,.35,.14,.3,(D-1)/2); 

91 [3Ubl2,scale]=scaling2 (z 32,mml ,SD1,(scale+1),R); 

92 showr(subl2,.19,.35,.14,.3,(D-l)/2); 

93 [3Ubl2,scale] =scaliiig2(z32,mml ,SD1, (scale+2) ,R); 

94 showr(subl2,.355,.35,.14,.3,(D-1)/2); 

95 [subl2,scale]=scaling2(z32,mml ,SD1,(scale+3),R); 

96 showr(subl2,.52,.35,.14,.3,(D-l)/2) ; 

97 C3ubl2,scale] =3calitig2(z32,mml ,SD1, (3cale+4) ,R); 

98 showr(subl2,.685,.35,.14,.3,(D-l)/2); 

99 [subl2,scale]=scaling2(z32,mml,SDl,(scale+5),R); 

100 showr(3ubl2,.85,.35,.14,.3,(D-l)/2); 

101 

102 [mm2,SD2,zp3]=mtar(N3Ub,D,z,kr,k7); 

103 if T zp3(jj)=maan(zp3(jj))+'cam;and 

104 z33=zp3+(s3*3ig*T); 

105 [subl3,scale]=scallng3(zs3,mm2,SD2,l,R); 

106 showr(subl3,.025,.65,.14,.3,(D-1)/2); 

107 Csubl3,scale]=scaliiig3(2s3,mm2,SD2, (scale+.S) ,R) ; 

108 showr(subl3,.19,.65,.14,.3,(D-l)/2); 

109 Csubl3,scale]=scallng3(zs3,mm2,SD2,(scale-f'.75) ,R); 

110 showr(8ubl3,.355,.65,.14,.3,(D-1)/2); 

111 [subl3,scale]=scaliiig3(z33,mm2,SD2,(scala+l) ,R); 

112 showr(subl3,.52,.65,.14,.3,(D-l)/2) ; 

113 [subl3,scale]=scaliiig3(zs3,min2,SD2,(3cale+1.5) ,R) ; 

114 showr(subl3,.685,.65,.14,.3,(D-1)/2); 

115 Csubl3,scale]=scaliiig3(zs3,mm2,SD2,(scale'i-2) ,R) ; 

116 showr(subl3,.85,.65,.14..3,(D-l)/2); 

117 

118 dispC’target number is’); 

119 disp (count); 

120 tgt = input(’is there a target? [(y/n); "(y/n) exits ... 

121 test loop] »’,’s’); 

122 if <tgt=»’y’l tgt”-’n’) 

123 count*count+l; 

124 if T; 

125 if tgt”’y’ 

126 disp<’CORRECT’); 

127 cl-cl+1; 

128 else 

129 dispC’WRONG’): 

130 c2-c2+l: 

131 end 

132 else 

133 if tgt”’y’ 

134 dispC’WRONG’); 

135 c4=c4+l; 

136 else 

137 disp(’CORRECT’); 

138 c3=c3+l: 

139 end 

140 end 

141 if count=floor(n/5) I count=floor(2*n/6) I count= . 

142 floor(3*n/5) I count=>=floor(4*n/5) |coimt==n; 
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143 [PD0,PFA0,siirexp,flag]=check(cl,c2,c3,c4,snniom,sigsnr) ; 

144 save opwdata cl c2 c3 c4 PDO PFAO snrexp sigsnr sig ... 

145 snmom D Nsub; 

146 writefiKcount,cl,c2,c3,c4,snrexp,PDO,PFAO,sigsnr,sig, ... 

147 snmom,D,Nsub); 

148 else 

149 PD0=cl/(cl+c2): 

150 PFA0=c4/(c3+c4): 

151 if PDQ<1 & PDO>0 & PFA0<1 JePFAO>0 

152 t2sig=erfinv(l-2*PFAQ); 

153 snrexp=sqrt(2)*{t2sig-erfinv(l-2*PD0)); 

154 sprintf (’PD0:y.5.4f PFAQ;7.5.4f snrexp;7.5.4f ’ ,PD0, ... 

155 PFAO,snrexp) 

156 end 

157 end 

158 if flag==l break; end 

159 else 

160 flag=l: 

161 break; 

162 end 

163 end 

164 PD0=(cl)/(cl+c2); 

165 PFA0=(c4)/(c3+c4); 

166 t2sig=erfinv(l-2*PFA0); 

167 3nrexp=sqrt(2)*(t23ig-erfinv(l-2*PD0)); 


PDGEN 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 
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21 
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*/, Function called PDgen used to calculate a set of random error 
y, results for the estimated PDO, PFAO operator 
y, performance results. 

y. 


y. 

•/. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 


INPUTS 
n (1,1) 

Nsub (1,1) 
sig (1,1) 
pill (1,1) 

D (1,1) 

z (256,256) 


number of trials 

size of background matrix to display 
target signal level 

box containing the signal disc at the center 
target diameter 
background to display 


OUTPUTS 
sigsnrd, 1) 
snrbard, 1) 
sig (1,1) 


= standard deviation of random snr results 
= mean value of random snr results 
= target signal level to conduct experiment with 


[PDO,PFAO]=PDgen(n,Nsub,D,sig,z.pill,M) 


function [PDO,PFAO]=PDgen(n,Nsub,D,sig,z,pill) 

[c1,c2,c3,c4.flag,PDO,PFAO]=exopr3(n/5,Hsub,D,sig,z,pill); 
sprintf (’PDO is :y.S.4f PFAO is:. 4f ’, PDO, PFAO) 
more = input(’do you want to try again? (y/n); »’,’s’): 
while more =• ’y’ 

nn“tnput(’enter number of trials to conduct’); 

3ig2=input(’enter the signal you want to use’); 

[cl, c2,c3,c4,flag,PDO,PFAO]=exopr3(nn,Nsub,D,sig2,z,pill); 
sprintf (’PDO is :y,S.4f PFAO i3:y,5.4f ’.PDO.PFAD) 
more = tnput(’do you want to try again? (y/n); »’,’s’): 
end 

if more==’n’fc PDO^l 
PD0-.999: 

elseif more=’n’t PFA0=0 
PFA0=.001: 

end 
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PDSNREST 

*/, Function called pdsnrest used to calculate a set of random error 
‘/, results for the estimated operator <PD,PFA)-pair. The program first 
■/. runs a set number of trials then calcinates the operator 
'/, experimental (PD,PFA)-pair. The program displays the experimental 
*/. (PD ,PFA)-pair to the operator and allous the operator to adjust the 
'/, experimental signal. When the operator is satisfied with the 
■/, experimental (PD,PFA)-pair the program use this experimental 
y, (PD ,PFA)-pair to calculate the effective signal-to-noise ratio 
y. (called snrbar in this progriim) and the standard deviation (sigsnr) 
snrbair. 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 
61 
62 

63 

64 

65 

66 


y. of 

y. 

y. INPUTS 

( 1 . 1 ) 
( 1 . 1 ) 
( 1 . 1 ) 
( 1 . 1 ) 
( 1 . 1 ) 
( 1 . 1 ) 
(256.256) 


number of trials 

size of background matrix to display 
tzirget signal level 

box containing the signal disc at the center 
number of monte carlo simulations to be run 
target diameter 
background to display 


y. n 
y, Nsub 

y. Sig 
y. pill 
y. M 
y. D 
y. z 
y. 

y. OUTPUTS 
y, sigsnrd.l) 
y. snrbard.l) 
y. sig (1.1) 

y. 

y, [sigsnr.snrbar. sig]=pdsnrest(n,Nsub,D,sig,z .pill,M) 


standard deviation of random snr results 

mean value of random snr results. 

target signal level to conduct experiment with 


function [sigsnr,snrbar,sig]=pdanre3t(n,Nsub,D,sig,z,pill,M); 
if ■exiat(’H’)i H=le3! end 

[cl,c2,c3,c4,flag,PD0,PFAO] =exopr3(n/5,Nsub,D,sig, z,pill); 
sprintfdPDO is :y,S.4f PFAO is:. 4f >,PDO,PFAO) 
more = inputddo you want to try again? (y/n); »’,’s’)i 
while more = ‘y’ 

nn”input(’enter number of trials to conduct’); 
sig2=input(’enter the signal you want to use’); 

[cl ,c2,c3,c4.flag.PDO,PFAO]=oxopr3(nn,Nsub,D,sig2,z,pill); 
sprintf(’PDO is :y,5.4f PFAO is:y,5.4f’,PDO,PFAO) 
more = input (’do you want to try again? (y/n); »’,’s’); 
end 

if more==’n’ ft PD0<1 ft PFA0>0 
hN=n/2: 

R=randd ,hN*H); 
ii=R<PD0: 

ii=reshape(ii,hH,M); 

TT=sum(ii); 

R=randd ,hH*M); 
pnf anoint PDO; 
ii”R<pnfanom; 
ii”reshape(ii,hN,M); 

NN“sum(ii); 

ii-f ind(Tr==hNlTT=0); 

TT(ii)>=n : 

NN(ii)=n; 

ii=find(NN==hN|NN=-0); 

TT(ii)=n : 

NN(ii) = n ; 

PD=Tr/hH; 

PFA=l-NN/hH; 
t2sig=erfinvd-2+PFA); 
s2sig=-erfinv(1-2*PD)+t2sig; 
ransnr=s2sig*sqrt(2); 
snrbaur=mean(ransnr); 
sigsnr=std(ransnr); 
if exist(’sig2’) sig=sig2; end 
A=100; 
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67 [Q ,H=hist (ransnr ,A) ; 

68 Q=Q(1;A-1): 

69 X=X(1:A-1); 

70 Q=cuiiisum(Q) ; 

71 Q=q/Q(len^h(Q)) ; 

72 linprb(Q,X); 

73 figure(gcf): 

74 end 


PSDGEN 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 
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Function called psdgen used to develop a two dimensional power 
spectral density (psd) from a two dimensional background scene. 

Based on the assumption of isotropy a one dimensional result, psd 
versus spatial frequency magnitude, is developed. A single scene is 
used and ensemble averaging is "accoii5)li3had" by averaging over a 
ring in spatial frequency space.The prograun uses spline interpolation 
on the calculated set of pad values to generate a two dimensional 
array of psd values corresponding to the frequencies of the two 
dimensionnal FFT of the input backgrovmd scene. 

•/. 


•/. 


•/, IKPUTS 

y, H (1,1) = Humber of spatial frequencies 

y, z (256,256) = Background scene 

y. 

y. 

y, OUTPUTS 

y, PSD (256,256) = 2-D version of psd 

y. 

y. PSD=p3dgen(H,z) 


function PSD=padgen(H,z); 

2Z=fft2(2); 

k=0:127; k=li -fliplr(k+l)]; 

k=ones(256,1)*k; 

k=k.'2; k=k+k’; k=3qrt(k); 

f=128*sqrt(2)*(l:H)/N: 

df=(f(2)-f(l))/2: 

psd'D: 

for n=l:H 

ii= find(k>f(n)-df k k<=f(n)+df); 

psd = Cpsd sum((abs(zz(ii))).‘2)/length(ii)] ; 

end 

p3d(35)=(p3d(34)+psd(36))/2; 
k=k(:); 

PSD=spline(f,psd,k); 

PSD=reahape(PSD,256,256); 


CAMO 

y. Function called camo. Used to generate a zero mean camouflaged 
y, disk pattern. The pattern corresponds to 
y, portion of the scene. 


randomly selected 


7 •/ 


INPUTS 

8 •/ 

D 

(1,1) 

9 •/ 

z 

(M,H) 

10 •/ 

ky 

(1,1) 

11 •/ 

kx 

(1.1) 

12 •/ 



13 •/ 



14 •/ 

: OUTPUTS 

15 7 

• cam 

(l,ii) 


= Diameter of circle region. 

= Random image field. 

= Random number (uniform,zero to one) 
s Random number (uniform,zero to one) 


Randomly chosen piece of background matrix. 
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16 •/. 

17 •/. 

18 •/. 

19 '/, caiiF=camo(D,z,kx,ky) 

20 
21 

22 function caiiF=camo(D,z,kx,ky) 

23 [>I,N]=3ize(z) ; 

24 a=(D-l)/2: 

25 x=(-R:R).‘2; 

26 x=ones(3ize(x’))*x; 

27 R2=x+x': 

28 ii=find(R2<=R*2); 

29 L=length(ii); 

30 ni=l+R+floor((H-(D-l))*kx); 

31 n=l+R-t-floor((H-(D-l))*ky); 

32 cam=z(m-R:iiH-R,n-R:n+R) ; 

33 mcirc=3U3n(cam(ii))/L; 

34 cam=cajn(ii)-mcirc; 



APPENDIX C COMMON PROGRAMS 


This appendix contains the text for the programs which are shared by all three experiments. The 
program GLINES plots the lines on the probability graph which correspond to a signal-to-noise 
ratios of (TIO). The program GAUSS is used to convert probabilities to the appropriate value 
corresponding to their location on the prbprb graph. The program converts probability distributions 
to the corresponding number of standard deviations of a gaussian distribution. The program called 
MAXMIN is used to find the appropriate axes scales to accomodate the entire range of the probability 
distribution to be plotted. The program PDPFAEFF calculates the operator effective (PD,PFA)-pair 
using ” Monte Garlo'’ techniques. The program PRBPRBER plots a (PD,PFA)-pair on a prbprb graph 
with error bars. The program PRPRLAER plots (PD,PFA)-pairs on a prbprb graph with labels on 
the effective signal-to-noise ratio lines. The program SNRGALG calculates the signal to noise ratio 
in gaussian noise of a given (PD,PFA)-pair assuming an unbiased threshold. SNRESTER estimates 
the effective snr of an experiment and it’s standard deviation based on ” Monte Garlo” techniques and 
the number of experimental trials. MAKEPILL outputs the matched filter of a disc shaped target. 
3 programs (SGALEl, SCALE2, SCALE3) each scale and limit the target/background images prior 
to display. Each scale program is used with different limits to display six background/target images. 
The three programs in effect serve as the operators color/contrast control knob. SHOW displays 
the eighteen background/target images on the computer monitor in greyscale format. WRITEFILE 
stores the experimental data to both a text and a data file.The program CHECK compares the 
effective signal-to-noise ratio of an experiment with the nominal signal-to-noise ratio and allows the 
operator to terminate the experiment. 


COMMON PROGRAMS 


GLINES 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 
23 


*/, function called glines used to generate PD PFA data sets for veurious 
’/, signed to noise ratios. The noise is taken to be zero mean gaussian. 

•/, 


•/, INPUTS 

'/, SNR (1,H) = set of signal to noise ratios 
% 


■/. 


y. OUTPUTS 

y. PFA(400,1)= sat of falsa alema probabilities for threshold to noise 
y. ratios from minus ten to plus ten 

% PD (400,H)=’ set of detection probabilities for the same thresholds, 
y, with each column corresponding to one of the SNR vedues. 

y. 

y. CPFA,PD] = glines (SNR) 


function [PFA,PD]= glines(SNR) 
T^linspace(-10,10,400); 

PFA-0.5*(1-erf(T’/sqrt(2))); 

PD=n; 
for s=SHR 

PD-EPD 0.5*(l-erf((T-s)>/sqrt(2)))]; 

end 


GAUS 


1 

2 

3 

4 

5 


mxixixixixixixixixixixixixixixixixm^^^^^ 


y, gaus. Function used to convert probability distributions to the 
y. corresponding number of standard deviations of a gaussian 
y. distribution. 


y. 
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6 7. INPUTS 

7 7, P (m,n) = matrix of probabilities 

8 7. OUTPUTS 

9 7. sds (m,n) = corresponding matrix of standard deviations 

10 7. 

11 7. sds=gaus(p) 

12 7. 

13 

14 function sds= gausCp) 

15 sds=sqrt(2)*erfinv(2*p-l); 

16 ii=find(sds=-inf I sds==inf); 

17 sd3(ii)=NaN*ones(3ize(ii)); 


MAXMIN 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 




7. Function called maxmin used to find maximum and minimum values in 
7. each column of an array. The max and min values are explicitly to 
7. ignore the presence ofNaN. 


7. 


7. INPUTS 

7. A (M,N) = Array uhose max values are to be found 

7. 


7. OUTPUTS 

7. mx (1,N) = String of maxi mum values 
7. mn (1,N) = String of mini mum values 

7. 


7i [mx,mn]=maxmin(A); 


function [mx,mn]=maxmin(A) 
[M,N]=size(A) ; 
mx=0 : mn=0 j 
for n=l:N 
a=A(:,n); 

ii=find(isnan(a)); 
a(ii)=zoros(3ize(ii)); 
b=mai(a); 
if b==0 

b=miTi(a) ; 

a(ii)=b*onas(size(ii)); 
b=Eiaz(a); 
end 

mi=0nx b] ; 
b=min(a); 
if b==0 

b=mai(a); 

a(ii)=b*ones(size(ii)); 
b=min(a); 

end 

mn* Imn b3 i 
end 


PDPFAEFF 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 




7. Function called PDPFAeff used to calculate a set of random error 
7. results for the estimated (PD,PFA)-pair for operator 
% (random) performance results. The PD, PFA random performance results 
7, are dravn from a set vhose distribution is governed by some no min a l 
7. snr and the number of trials. It is assumed that half the trials 
7. have targets and half do not, and that the operator’s effective 
7. threshold is at half the nominal snr. 


7. 


7. 

7, INPUTS 

7. H (1,1) = number of trials 

7, snmomd,!) - nominal signal to noise ratio 
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14 Vi M (1,1) = number of monte carlo simulations to be run 

15 */. 

16 •/. 

17 ■/. OUTPUTS 

18 ■/. sigPDc (1,1) = standard deviation of random PD results using 

19 y, std(PD). 

20 ■/. sigPFAcd,!) = standard deviation of random PD results " " " 

21 ■/, PDH (1,1) = Monte Carlo Probability of detection. 

22 y, PFAM (1,1) = Monte Carlo probability of false alarm. 

23 y. 

24 y. 

25 y. CsigPDc,sigPFAc,PDM,PFAM]=PDPFAeff(H,snmom,M) 

26 

27 function [sigPDc,sigPFAc,PDM,PFAM]=PDPFAeff(H,snmom,M) 

28 if 'exist(’M’)! M=le3; end 

29 p=(l-6rf (snmom/(2*sqrt(2))))/2: 

30 q=l-p; 

31 hN=H/2: 

32 R=rand(l,hN*M): 

33 ii=R<q; 

34 ii=ra3hape(ii,hH,M); 

35 TT=sum(ii); 

36 ii=R<q; 

37 ii=re3hapa(ii,hN,M); 

38 HH=8inii(ii) ; 

39 ii=find(TT==hNITT=0): 

40 TT(ii) = n; 

41 NH(il) = n: 

42 ii=find(NN==hNlHH=0); 

43 TT(ii) = a; 

44 HH(ii) = a: 

45 PD=TT/hK: 

46 PFA=l-NN/hH: 

47 PDM=mean(PD); 

48 PFAM=mean(PFA); 

49 sigPDc=std(PD); 

50 sigPFAc=std(PFA); 


PRBPRBER 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 
27 


y, prbprber Function used to plot a pair of probability 
y, distributions against each other on a graph whose scales each 
y, correspond to the gaussian distribution . This program displays 
y, error bars on operator data point. This program allows the user 
y, to select the axis size of the graph. 

•/. 

•/. 

•/, INPUTS 

*/. PI (1 or m,n) = Set of probabilities associated with horizontal 
'/. axis by convention PFA 


y. P2 (m,n) “ Set of probab 

7. by convention 

'/. h (1,1) = handle for gr 

■/. s (string) = string indica 

7 . 

7. OUTPUTS 

7i H (1,1) = Handle of gra 

7. 

7. 

7. 

'/, H=prbprber(Pl,P2,h,s) 

7. 

function H=prbprber(Pl,P2,h,s) 
if exist(’hO 

if isstr(h); s=h: clear h; end 

end 


Set of probabilities associated with horizontal 
axis by convention PFA 

Set of probabilities associated with vertical axis 
by convention PD 

handle for graph on which P1,P2 are to be plotted 
string indicating how data is to be displayed 


Handle of graph on which PI, P2 have been plotted 
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28 

format long E 




29 

labl = [’ 

: . ; 

9 ’: ’ 

’;’ le-7 ’: ’ ’; ’ le-5 

30 

3 3 . 

J 

’0.001 

’;’0.01 

;’0.1 ’;’0.2 ’ 

31 

3 3 . 

t 

’0.5 

3.3 3 . 

> ’;’0.8 ’;’0.9 

32 

’0.99 ’; 

’0.999 

’;’ 4-93 ’; 

’ 5-93 ’; ’ ’; ’ 7-93 ’; 

33 

’ ’;’ 9-93 

’: ’ 

’1; 


34 

labela = [le-10 

le-9 le- 

8 le-7 le-6 

le-5 0.0001 0.001 0.01 0.1 

35 

0.2 0.3 

0.4 

0.5 0.6 

0.7000 0.8000 0.9000 0.9900 

36 

0.9990 l-le-4 1 

-le-5 1- 

le-6 l-le-7 

l-le-8 l-le-9 1-le-lO]; 

37 

[j j ,ii]=maxminCgausCPl)) 

: jj^xCjj) 

; ii=mlnCii); 

38 

ii=findCgau3Clabel3)<ii) 

; ii=maxCii) 

; if ii==0: ii=l: end 

39 

jj=findCgau3Clabel3)>jj) 

: jj=minCjj) 

; if jj==0: jj=27; end 


40 lablx=labl(ii;jj,1:7); labelsx=labels(ii: jj); 

41 [j j ,ii]=maxniiii(gaus(P2)) : jj=max(jj); ii=miii(ii) : 

42 ii=find(gaua(labels)<ii); ii=max(ii); if ii==0: ii=l; end 

43 jj=find(gaus(labol3)>j j) : jj=min(jj); if jj==D: jj=27; end 

44 lably=labl(ii:jj,l:7); labalsy=labels(ii:jj); 

45 labelsx=gaus(labelsx); 

46 labelsy=gaus(labelay): 

47 if 'exiatC’h’) 

48 hold off 

49 cla reaet,clf 

50 deleta(H) 

51 H=gca 

52 elae 

53 H=h: 

54 end 

55 aetCH,'YLim’,CminClabelay) max(labelay)]); 

56 aetCH,’XLim’, DninClabolax) maxClabelax)]); 

57 aet(H,’FontSize’,6); 

58 aetCH,’xtick’.labelax,’xticklabela’,lablx,’box’,’on’); 

59 aetCH,’ytick’,labalay, ’yticklabela’,lably): 

60 hold on 

61 H=inputC’How many triala did you run in the experiment? ’) 

62 if exiatC’s’) 

63 t23ig=arfinvCl-2»Pl); 

64 323ig=-erfinvCl-2*P2)+t23ig; 

65 3nmoni=a23ig*3qrtC2); 

66 [aigPDc ,3igPFAc ,PDm,PFAm3 =PDPFAef f CH,3nmom) 

67 PFAe=CPl-3igPFAc PI Pl+aigPFAc]; 

68 PDe=CP2-3igPDc P2 P2+3igPDc]; 

69 3dv=gausCP2);3dh=gausCPl): 

70 plotCsdh,3dv,’♦’) 

71 3dve=gau3CPDa):3dha=gauaCPFAe); 

72 plotC3dha,3dv*ona3CsizeC3dha))); 

73 plotCadh^oneaCaizeCadve)),3dve); 

74 

75 elae 

76 t23ig=erfinvCl-2*Pl): 

77 323ig=-erfinvCl-2*P2)+t23ig; 

78 3nmora=a23ig*3qrtC2); 

79 [3igPDc, aigPFAc, PDm, PFAm] =PDPFAef f CH, snmom) 

80 PFAe= CPl-aigPFAc PI Pl-^sigPFAc] ; 

81 PDe“CP2-3igPDc P2 P2+3igPDc]; 

82 3dv=gauaCP2):sdh=gau3CPl); 

83 plotC3dh,3d7) 

84 adve-gausCPDe);3dhe=gau3CPFAe); 

85 plotC3dhe,3d7*oneaC3izeC3dhe))); 

86 plotC3dh*one3C8izeC3dTe)),3dTe); 

87 

88 end 

89 xlabelC’PFA’): 

90 ylabelC’PD’); 

91 fig 

92 3ize=inputC’ Do you want to aize the graphica box ? y/n ’, ’a’); 

93 if 3ize==’y’ 

94 ax”inputC’ What aize axia do you want le-l-le-10’); 

95 prbprbCCax Cl-ax)3,CCl-ax) ax],H,’.’) 
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96 else 

97 end 


PRPRLAER 

2 V, prprlaer Function used to plot a pair of probability 

3 y. distributions against each other on a graph whose scales each 

4 '/. correspond to the gaussian distribution and have gaussline labels 

5 '/, and error bars on data. 

6 •/. 


7 

•/. INPUTS 



8 

y, PI (1 or m,n) 

= Set of probabilities associated with horizontal axis 

9 

•/. 

by convention PFA 


10 

y, P2 (m,n) 

= Set of probabilities associated 

with*vertical 2 ixis 

11 

y. 

by convention PD 


12 

y. h ( 1 , 1 ) 

= handle for graph on which P1,P2 

are to be plotted 

13 

y. s (string) 

- String indicating how data is to be displayed 

14 

y. 



15 

y. OUTPUTS 



16 

y. H ( 1 , 1 ) 

= Handle of graph on which PI, P2 

have been plotted 

17 

y. 



18 

y. 



19 

y. 



20 

y, H=prprlaer(Pl,P2,h,s) 


21 

y. 



22 

function H=prprlaer(Pl,P2,h,s) 


23 

if exist(’h’) 



24 

if is3tr(h); 

s=h: clear h; end 


25 

end 



26 

format long E 



27 

snrlabh=le-9j 



28 

snrlabv=[le-6 0. 

00007 0.005 0.05 0.3 0.6 0.9 0.99 

0.9995 l-le-5]; 

29 

labl = [’ 

’:’ le-9 ’:’ ’;’ le-7 ’;’ 

), 

30 

’ le-S ’:’ 

’! ’0.001 ’;’0.01 ’:’0.1 ' 

'; ... 

31 

’0.2 

’:’ ’;’0.5 ’; ’ ’; 

: «.. 

32 

’ ’;’0.8 

’;’0.9 ’:’0.99 ’;’0.999 ’; 

;’ 4-9s ’; ... 

33 

’ 5-9s ’: ’ 

’:’ 7-9s ’;’ ’;’ 9-9s ’; 

’]; 

34 

labels = [le-10 

le-9 le-8 le-7 la-6 le-5 0.0001 0. 

.001 0.01 0.1 ... 

35 

0.2 0.3 

0.4 0.5 0.6 0.7000 0. 

.8000 0.9000 0.9900 . 

36 

0.9990 l-le-4 1 

.-le-6 l-le-6 l-le-7 l-le-8 l-le-9 

1-le-lO]: 

37 

[j j ,ii]=maxmin(gau3(Pl)) ; jj=max(jj); ii=iain(ii); 



ii=find(gau3(labels)<ii) : ii=inai(ix); if ii~D; ii=l; end 
j j=find(gau3(label3)>j j) ; jj=min(jj); if jj==n; jj=27; end 
labli=labl(ii:jj ,1:7); labelsi=labels(ii:jj); 

[j j ,ii]=inaimin(gaus(P2)) ; j j=iiiax(j j) ; ii=]iiin(ii) ; 
ii=flnd(gaus(labols)<ii): ii=inax(ii); if ii^Q; ii=l: end 
jj=find(gaua(labels)>jj): Jj=min(jj); if jj==0; jj=27: end 
lably=labl(ii:jj,1:7); labelsy=labels(ii:jj); 
labelsi=gau3(labelsx); 
labelsy=ga\ia(label3y); 
snrlabh=gaus(snrlabh); 
snrlabv=gaus(snrlabv); 
if 'eiiat(’h’) 
hold off 
cla reset,clf 
delete(H) 

H=gca 

else 

H=h: 

end 

set(H,’YLim’, DninClabelsy) marClabelsy)]); 
set(H,’XLiffl’,Cmin(labelsx) max(labelsx)]); 
set(H,’FontSize’,6); 

setCH, ’xtick’.labelsx,’xticklabels’,lablx,’box’,’on’); 
set(H,’ytick’.labelsy,’yticklabels’,lably); 
for T=l:10 
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63 if T==l 

64 Glab=spriiitf (’snr= V.l.Of’.T); 

65 text(snrlabh,siirlabv(T) ,Glab); 

66 else 

67 Glab=spr intf (’•/.!. Of’.T); 

68 tert(snrlabh,snrlabv(T),Glab); 

69 end 

70 end 

71 

72 hold on 

73 N=input(’Ho« many trials did you nm in the experiment? 

74 if exist(’s’) 

75 t2sig=erfinv(l-2*Pl); 

76 s2sig=-erfinv(l-2*P2)+t23ig; 

77 snmonFa2aig*3qrt(2); 

78 [a igPDc, sigPFAc, PDm, PFAm] =PDPFAef f (U, anmom) 

79 PFAe=CPl-3igPFAc PI Pl+aigPFAcl; 

80 PDa=[P2-3igPDc P2 P2+3igPDc]; 

81 adv=gaua(P2);sdh=gau3(Pl); 

82 plot(sdh,sdv,’»’) 

83 sdve=gaua(PD6);sdhe=gau3(PFAe); 

84 plot(sdhe,sdv*onea(3iza(sdhe))); 

85 plot(sdh*one3(size(sdve)).adve); 

86 else 

87 t2sig=erfinT(l-2*Pl): 

88 32sig=-erfinv(l-2*P2)+t23ig; 

89 3nmom=a23ig*3qrt(2): 

90 [aigPDc, aigPFAc, PDm,PFAm] =PDPFAef f (H,anmom) 

91 PFAe=[Pl-3igPFAc PI Pl+aigPFAc] ; 

92 P0a=CP2-aigPDc P2 P2+aigPDc]; 

93 sdT«gau3(P2);adh=gau3(Pl)i 

94 plot(adh,adv) 

95 3dvo=gau3(PDe)isdhe=gau3(PFAe)! 

96 plotCsdhe.sdv+oneaCaizeCsdhe))); 

97 plot(sdh*ones(3iZ9(sdva)),sdvo); 

98 end 

99 xlabol(’PFA’)i 

100 ylabel('PD’): 

101 prbprbCC.0000000001 .9999999999],[.9999999999 .0000000001],H,’.’); 

102 hh=H 

103 load start 

104 prbprb(PFA,PD,hh) 

105 fig 


SNRCALC 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 




'/, Function called snrcalc designed to calculate the signal to noise 
y, voltage ratio of a target in random white Gaussian noise. 

•/. 


•/. 

y. INPUTS 

y, sig ( 1 , 1 ) = 

y, noise (1,1) = 

y. D (1,1) 

y. 

y. G (256,256) = 

y. Hsub (1,N) 
y. filt (Nsub,Nsub)= 

y. 

y. OUTPUTS 
y, sigma (1,1) 

y. 

y. signal (1,1) = 

y. 

y. 

y, snr (1,1) 


Input pixel value of taurget 

Iz^ut pixel value of noise 

Diameter of circular disc to be used in 

defining the filter; D must be odd. 

Background scene (RWG) 

Size of background scene to display 
unit pillbox filter 


standard deviation of the of the pixel values 
when no target was present. The noise, 
mean value of the pixels when the target was 
present minus the mean value of the pixels 
when no target was present 
Signal to noise ratio 
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22 7, snmom (l.l) = nominal signal to noise ratio 

23 7. 

24 7. 

25 7, [sigma,signal,snr,snmontl=snrcalc(sig,noise,D,G, ,Hsub,filt); 

26 

27 function [sigma,signal,snr,snmom]=snrcalc(sig,noise,D,G,Nsub,filt); 

28 R=(D-l)/2; 

29 RH=(Hsub-l)/2; 

30 x=(-RN:RN).‘2; 

31 x=ones(size(x’))*x; 

32 R2=xtx'; 

33 ii=find(R2<=R‘2); 

34 L=length(ii); 

35 pd=256-Hsub; 

36 qd=256-Nsub; 

37 Suml= □ : 

38 N=1000; 

39 for b=l:M 

40 (RN+l)+pd*rand(l,l); 

41 y= (RN+l)-t-qd*rand(l, 1) ; 

42 Z= G(x-RN:x+RH,y-RH:y+RH): 

43 Suml=[Suml; sum(sum(Z. *f ilt) )] ; 

44 end 

45 Sums=[Suml♦noise Suml^noise+sig^L]; 

46 3igma=3td(Siims(: , 1)); 

47 bac!c=maan(Sum3(: ,1)): 

48 taTg=maan(Sui[i3(: ,2)); 

49 3ignal=targ-back; 

50 3nr=(signal)/3igma; 

51 sinoiii=L^aigj 

52 nonom = sqrt(L*(noise'2)); 

53 3nmom=slnoBi/nonomj 


SNRESTER 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 


% Function called snrester used to calculate a set of random error 
7> results for the estimated signal to noise ratio for PD, PFA 
7. operator (random) performance results. The PD, PFA random 
y, performance resultsare draun from a set vhose distribution is 
7, governed by some nominal snr and the number of trials. It is 
7, assumed that half the trials havetargets and h 2 df do not, and that 
7. the operator's effective threshold is at half the nominal snr. 

7 . 

7. 

7. INPUTS 

7. H (1,1) 

7, snmomd,!) 

7. M (1,1) 

7 . 

7 . 

7. OUTPUTS 

sigsnr (1,1)= standard deviation of random snr results 
7, snrbar (1,1)= mean value of random snr results. 

7, ransnr (1,M)= set of random snr results. 

7. PDM (1,1)= Monte Carlo Probability of detection. 

7, PFAM (1,1)= Monte Carlo probability of false alarm. 

7. 

7 . 

7. [sigsnr, snrbar, PD, PFA, ransnr] =snrs3ter(H, snmom, M) 


number of trials 

nominal signal to noise ratio 

number of monte carlo simulations to be run 


funct ion [sigsnr, snrbar, PDM, PFAM, ransnr]=snrester(H, snmom, M) 

if "existCM’); M=le3; end 

p= (1-erf (snmom/ ( 2^3qrt (2))))/2; 

q=l-p; 

hN=H/2: 

R=rand(l,hH%M); 
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33 ii=R<q; 

34 ii=reshape(ii,hN,M); 

35 TT=suin(ii) ; 

36 ii=R<q; 

37 ii=resliape(ii,hH,H); 

38 NH=suin(ii) ; 

39 ii=find(TT==hNlTT==0); 

40 TT(ii) = []: 

41 NN(ii) = n; 

42 ii=f iiid(NN==hN I HH=0); 

43 ■rr(ii) = n; 

44 NN(ii) = n: 

45 PD=TT/hH; 

46 PFA=l-NH/hH; 

47 t2sig=6rf iiiv(l-2*PFA); 

48 s23ig=-erf iiiv(l-2*PD)+t23ig: 

49 raii3nr=s23ig*aqrt(2) ; 

50 3iirbar=mBan(raiisnr) ; 

51 sig 3 nr=std(ransiir); 

52 PDM=iiiean(PD); 

53 PFAM=1-PDM; 


MAKEPILL 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 


*/, Function called makeplll used to generate a unit pillbox of 
*/, target 3ize. 

y. 

% 


•/. INPUTS 

y, Nsub (1,1) = Size of the portion returned of whitened signal 

•/, disc (an odd number) 

y. D (1,1) = Circle diameter (an odd number) 

y. 

y. OUTPUTS 

y. 

y, pill (H3ub,Nsub)= Box containing signal disc at center 

y. 

y, pill=makepill(Hsub,D) 


function pill=makapill(Naub,D); 

R=(D-l)/2; 

if rem(Hsub,2)=l 

x='((-(Nsub-l)/2: (Naub-l)/2)). '2; 
x=«onos(size(x ’)) *r; 

R2=x-t-x’; 

ii=*find(R2<=R‘2) ; 
pill=zero3(Nsub,Nsub ); 
pill(ii)=ones(size(ii)); 
else rem(N3ub,2)==0; 

x“(-Nsub/2:(Naub/2-1))."2; 
x~ones(sizo(i’))*r: 

R2»rtx'; 

ii=f inid(R2<=R“ 2) ; 
pill=zeros(Nsub,Nsub); 
pill(ii)=ones(size(ii)); 
end 


SCALINGl 


1 

2 

3 

4 

5 

6 
7 


y. Function called sccilingl used to scale the display to show pixels 
y. having a value some specified number of standard deviations 
y, about the mean. 

y. 

y. 

y. INPUTS 
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8 

y, zsi 

(51.51) 

= image with target 

9 

A Tnm 

(1.1) 

= mean value of the target region 

10 

y. SD 

(1,1) 

= pixel standard deviation in sub without target 

11 

y. scale 

(1,1) 

= half the number of standard deviations in full 

12 

y. 


display dynamic range 

13 

14 

y. R 

y. 

(1.1) 

= Target circle radius 

15 

y. 

OUTPUTS 


16 

y, zsii 

(51,51) 

= scaled and limitted version of sub 


17 •/. 

18 y. Z3ll=scaliiigl(sub,mm,SD,scale,R) 

19 

20 function zsll=scalingl(zsl,mm,SD,scale,R); 

21 b=l/(2*scale*SD); 

22 a=-b*(inn-scale*SD); 

23 zsll=a+b*z3l; 

24 jjl=f indCzslKO) ;z3ll(jjl)=zero3(size(j jl)) ; 

25 jju=find(zsll>l);z3ll(jju)=onea(size(jju)); 


SCALING2 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 




t 

•/. 

•/. 

•/. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 

y. 


Function called scaling2 used to scale the display to show pixels 
having a value between the minimum value of background scene pixels 
and a value near the mean value of the background scene pixels. 


IHPUTS 

z32 (51,51) 

mm (1,1) 

SD (1,1) 

scale (1,1) 

R (1.1) 


image with target 

mean value of the target region 

pixel standard deviation in sub without target 

the number of standard deviations in full display 

dynamic range 

Target circle radius 


OUTPUTS 
Z321 (51,51) 

scale (1,1) 
[zs21, scale] 


scaled and limitted version of zs2 

the number of standard deviations in full display 

seal ing2(sub ,nmi,SD .scale ,R) 


function Czs21,scale]=scaling2(zs2,mm,SD,scale,R); 
F=l; 

while F==l; 

x=(-R:(R-l))."2; 
x=ones(size(x’))*x: 

R2=x+x'; 

ii=*flnd(R2<=R‘2) ; 
msub=zs2; 

msub(ii)=onea(3ize(msub(ii)))*min(msub(ii(:))); 

HW^ min fmmibf ; ) ) ; 

MEAH=msan(msub(:)); 
scale1=((KEAN)-MN)/6; 

MH2=HH+(scale+l)*scalel; 
zs21=zs2; 

uu“find(zs2>=MN2); 

zs21(uu)=ones(size(zs21(uu)))*HH2; 

if min(min(zs21))'=max(max(zs21)) ; 

F=0; 


else scale==scale*1.5; 
end 


end 


SCALINGS 


1 

2 




y. Function called scaling3 used to scale the display to show pixels 
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3 "/, having a value between the maximum value of background scene pixels 

4 */, and the meeui value of the background scene pixels. 

5 7. 

6 7. 

7 7. INPUTS 


8 

7. zs3 

(51,51) = image with target 


9 

7, mm 

(1,1) = mean value of the target region 

10 

7. SD 

(1,1) = pixel standard deviation in 

sub without target 

11 

7, scale 

(1,1) = half the number of standard 

deviations in full 

12 

7. 

display dynamic range 


13 

7. R 

(1,1) = Target circle radius 


14 

7. 



15 

7. 

OUTPUTS 


16 

7. zs31 

(51,51) = scaled and limitted version 

of sub 

17 

7. 



18 

y, Czs31, scale] =acaliiig3 (sub,mm,SD, scale, R) 



19 

20 

21 function [zs31,3cala]=3caling3(zs3,mm,SD,scale,R); 

22 F=l; 

23 while F==l; 

24 x=(-R:(R-l)).'2; 

25 x=onea(3ize(x’))*x; 

26 R2=i+x': 

27 ii=find(R2<=R“2): 

28 msub=zs3; 

29 m3ub(ii)=zeros(slze(iii3ub(ii))); 

30 MX=max(m3ub(:)); 

31 HEAN=mean(m3ub(:)); 

32 scale1=(MX-(MEAN))/6: 

33 MX2=MX-((8cale)*scalel) ! 

34 zs31>zs3; 

35 ll=find(zs3<=MEAK); 

36 zs31(ll)=ones(size<zs31(ll)))*MEAN; 

37 uu“find(zs3>=KX2); 

38 zs31(uu)=ones(sizeCzsSlCuu)))*MX2; 

39 if min(min(zs31))~°max(maz(zs31)); 

40 F=0: 

41 else scale=(scale-.5); 

42 end 

43 

44 end 


SHOWR 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 


7.7.7.7.7.7.7.7.7.7.7.7.7X/.7.7.7.7.7.7.7.7.7X/.7.7.7.7.7.7.7.7.7.7.7.y.7.7.7.7,7,7.7.%^ 


7, Function called shovr used to display in grayscale format 
% a data array, with a specified position and size, used with real 
7. background noise. The program highlights the target area with a ring 
7, of target circumference. 


7. 

7. 

% subl 
7. a 
7. b 
7. c 
7. d 
7. R 


INPUTS 

(N,H) = data array for display 

(1,1) = x-azis position LL comer 

(1,1) = y-axis position U. comer 

(1,1) ” x-axis image size 

(1,1) = y-axis image size 

(1,1) = circle radius 


7. 

7. showr(subl,a,b,c,d,R) 


function showr(subl,a,b,c,d,R) 

x=(-R:(R-l)).‘2; 

x=ones(size(x’))*x; 
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23 R2=x+x’; 

24 ii=find(R2<=R'2); 

25 AX = axesC’position', [a bed]); 

26 axesCAX); 

27 axis off; 

28 coiormapCbone); 

29 caxis(’auto’); 

30 pcolor(subl): 

31 shading flat 

32 hold on; 

33 [M,tO-size(subl) ; 

34 t=linspace(0,2*pi,100);cy=(R+l)»sin(t);cx=(R+l)*cos(t); 

35 plot(cx+(M/2+l),cy+(M/2+l),’y;'); 

36 cx=ones<l,100); cy=linspace(l,N,100); 

37 plot(cx,cy,’y’); 

38 cx=N+onea(l,100); cy=llnspace(l,N,100); 

39 plot(cx,cy,’y’); 

40 cy=onos(l,100); cx=linspace(l,N,100); 

41 plotCcx.cy,’y’); 

42 cy=H+one3(l,100); cx=linspace(l,H,100); 

43 plot(cx,cy,’y’); 

44 hold off; 

45 axis off; 

46 


WRITEFIL 


1 

2 

3 

4 

5 

6 


y, function called writefila designed to write experimenteil data 
% to a .mat file and a .txt file for future use. The .mat files are 
y, called opudata-.mat and the text files are called dataopw.. 

y. 

y. 


7 

y. INPUTS 



8 

y. n 

(1.1) 

= number of displays 

9 

y, Hsiib 

(1,1) 

= size of the background scene for display. 

10 

y. D 

(1.1) 

= circle Diameter 

11 

*/■ sig 

(1,1) 

= Target signal 

12 

y, noise 

(1.1) 

= Target noise 

13 

y, snmom 

(1.1) 

== nominal signal to noise voltage ratio 

14 

y, sigsnr 

(1,1) 

= standard deviation of the signal to noise 

15 

y. 


ratio 

16 

y. cl 

(2,1) 

- number of times target was present and 

17 

y. 


detected 

18 

y, c 2 

(2.1) 

= number of times teirget was present emd not 

19 

y. 


detected 

20 

y. c3 

(2.1) 

= number of times no target and no detection 

21 

y. c4 

(2,1) 

= number of times no teirget and false detection 

22 

y, PDo 

(1,1) 

= Probability the target was present and the 

23 

y. 


operator identified it 

24 

y. PFAO 

(1,1) 

= Probability the target was not present but 

25 

y. 


the operator thought it was present 

26 

y. snrexp 

(1,1) 

= Signal to noise voltage ratio of the operator 

27 

y. 


during the experiment 

28 

y. 



29 

y. 



30 

y, OUTPUTS 



31 

y, none 



32 

y. 



33 

y. writefil(n,cl,c2,c3, 

c4, snrexp, PDO, PFAO, sigsnr, sig, snmom, D, Nsub) 

34 




35 

function writefiKn.cl 

,c2 ,c3 ,c4 .snrexp, PDO, PFAO, sigsnr, sig, snmom, D ,Hsub) 

36 

write-inputC 

Is this a 

new file? Cy if a new; any key if not ] »’,’s’); 

37 

if write=”’y’ 

t 


38 

load fnum; 



39 

fnui^fnuaH-1; 


40 

save fnum fnum; 
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41 fid=fopenCsprintf (^dataopw#'/,!.Of * ,’w*); 

42 operator=input(’please enter your first and last name >>’,’s’); 

43 fprintf(fid,operator): 

44 fprintf (sprintf( ’ dataopw#'/,!. Of ’ ,fnum) , ’\nn=*/Cl .Of \ncl=*/.l. Of . . . 

45 \nc2=‘/.1.0f\nc3=y,1.0f\nc4='/.1.0f\nsnrexp=y.7.6f\nPD0='/.7.6f .. . 

46 \nPFAQ=y.7.6f\nsigsnry.7.6f\nsig=y.4.3f\nsnmom=y.5.4f\nD=y.l.0f . . . 

47 \nNsub=y.l.0f\n\n' ,n,cl ,c2,c3,c4,snrexp,PD0.PFA0,sigsnr,sig, . . . 

48 snmom.D.Nsub) : 

49 else 

50 load fnum 

51 fprintf (sprintfCdataopw#*/,!.Of ’ ,fnum), ’\nn=‘/.1.0f\ncl='/.1.0f . . . 

52 \nc2=*/,1.0f\nc3=’/.1.0f\nc4=‘/.1.0f\n3nrexp=*/.7.6f\nPDQ=‘/,7.6f ... 

53 \nPFA0=‘/.7.6f\nsigsnr'/.5.6f\nsig=‘/.1.0f\n3nmom=*/.5.4f ... 

54 \nD=‘/.1.0f\nNsub=‘/.1.0f \n\n’,n,cl,c2,c3,c4,snrexp,PD0, ... 

55 PFAQ.sigsnr .aig.snmom.D.Hsub) : 

56 end 

57 

58 

59 


CHECK 
1 
2 

3 

4 


24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 

43 

44 

45 


function called check used to enstire that in an experiment an 
operator performs within an acceptable limit (two st and a r d 
deviations) of the nominal signal to noise voltage ratio. 


~ nominal signal to noise voltage ratio 
= number of times target was present and 
detected 

= number of times target was present and not 
detected 

= number of times no target and no detection 

- number of times no target and false detection 

- standard deviation of the signal to noise ratio 


= Probability the target was present and the 
operator identified it 

= Probability the target was not present but 
the operator thought it was present 

= Signal to noise voltage ratio of the operator during 
the experiment 

= experimental exit flag, flag =1 stops experiment 


[PDO, PFAO, snrexp, f lag] =check(cl, c2, c3, c4, snmom, sigsnr) 


5 

•/. 

INPUTS 

6 

y, snmom 

(1,1) 

7 

y. cl 

(2,1) 

8 

y. 


9 

•/. C2 

(2,1) 

10 

•/. 


11 

'/. c3 

(2,1) 

12 

'/. c4 

(2,1) 

13 

*/, sigsnr 

(1,1) 

14 

•/. 


15 

y. 


16 

•/. OUTPUTS 

17 

y. PDO 

(1,1) 

18 

•/. 


19 

•/. PFAO 

(1,1) 

20 

y. 


21 

'/, snrexp 

(1,1) 

22 

•/. 


23 

y. flag 

(1,1) 


function [PDO,PFAQ,snrexp,flag]=chack<cl,c2,c3,c4,snmom,sigsnr) ; 
PD0-cl/<cl+c2): 

PFA0=c4/(c3+c4); 
t2sig=erfinv(l-2+PFA0); 
snroip=sqrt(2)*(t2sig-erf lnv(l-2*PD0)); 
lower=snmom-l. 96*sigsnr; 
iq>per”snmoiiH-l. 96*8ig3nr; 

if snrexpc lower I snrexp > vq>per; 
dispC’yon are out of tolerance’); 
sprintf (’your snrexp is : '/,5.4f’,snrexp) 

sprintfC’the acceptable tolerance is : y3.4f to '/,5.4f’,lower, 
upper) 

cont=inputC’do you want to 8top?[y stops the test, any key to 
continue ] »’, ’s’); 
if (cont“=’y’); 

flag=l; 

else 

flag=0; 

end 
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46 else sprintf (’GOOD JOB! your snrexp is : ’/,5.4f ’ .snrexp) 

47 fl2ig=0; 

48 end 

49 
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APPENDIX D. MONITOR DISPLAY 


This appendix contains greyscale representations of the monitor display shown to the operator for 
each of the experiments In each display there is a target present however the reader may not percieve 
the target in every display. In the experiments the operator only had to identify a target in a single 
display. If he could see the target in any of the eighteen greyscale representationsthen he made the 
decision that the target was present. 
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EXPERIMENT 1 MONITOR DISPLAY 
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EXPERIMENT 2 



DISPLAY 
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EXPERIMENT 3 


DISPLAY 
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